Job ID step status up to date date started date completed duration message 22731step1-simulation success yes 2019-05-17 01:10:06+00:00 2019-05-17 01:15:04+00:00 0:04:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6479169221217771 survival_time_median 2.1500000000000004 deviation-center-line_median 0.15590115942208976 in-drivable-lane_median 0.5000000000000004
other stats agent_compute-ego_max 0.19643118977546692 agent_compute-ego_mean 0.17858458378840245 agent_compute-ego_median 0.1758042989775192 agent_compute-ego_min 0.17079447171626946 deviation-center-line_max 0.19953979422695187 deviation-center-line_mean 0.1357029359841886 deviation-center-line_min 0.07487325540147884 deviation-heading_max 0.85367880309064 deviation-heading_mean 0.4498219379762553 deviation-heading_median 0.4467802714694448 deviation-heading_min 0.17294554879163923 driven_any_max 1.6073018714938156 driven_any_mean 1.014988632836809 driven_any_median 1.0450791712354828 driven_any_min 0.27856899895495957 driven_lanedir_consec_max 1.0464264885045251 driven_lanedir_consec_mean 0.6465287422918354 driven_lanedir_consec_min 0.2709059386019117 driven_lanedir_max 1.0464264885045251 driven_lanedir_mean 0.6586298833340475 driven_lanedir_median 0.7049381348529349 driven_lanedir_min 0.2709059386019117 in-drivable-lane_max 1.8999999999999948 in-drivable-lane_mean 0.6799999999999983 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6073018714938156, "sim_physics": 0.058955186452621065, "survival_time": 3.899999999999994, "driven_lanedir": 0.7049381348529349, "sim_render-ego": 0.061640611061683066, "in-drivable-lane": 1.8999999999999948, "agent_compute-ego": 0.17079447171626946, "deviation-heading": 0.85367880309064, "set_robot_commands": 0.07834884142264342, "deviation-center-line": 0.15590115942208976, "driven_lanedir_consec": 0.6479169221217771, "sim_compute_sim_state": 0.04287863694704496, "sim_compute_performance-ego": 0.0640416084191738, "sim_compute_robot_state-ego": 0.0652299294104943}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0450791712354828, "sim_physics": 0.06161173554353936, "survival_time": 2.1500000000000004, "driven_lanedir": 0.9288656739545846, "sim_render-ego": 0.06684896557830101, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.1758042989775192, "deviation-heading": 0.5852517715197922, "set_robot_commands": 0.07921925256418627, "deviation-center-line": 0.1687691146525361, "driven_lanedir_consec": 0.9288656739545846, "sim_compute_sim_state": 0.04337060728738474, "sim_compute_performance-ego": 0.0682473903478578, "sim_compute_robot_state-ego": 0.06823523654494175}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.27856899895495957, "sim_physics": 0.061940282583236694, "survival_time": 0.8000000000000002, "driven_lanedir": 0.2709059386019117, "sim_render-ego": 0.06398138403892517, "in-drivable-lane": 0, "agent_compute-ego": 0.19643118977546692, "deviation-heading": 0.19045329500976027, "set_robot_commands": 0.0786476731300354, "deviation-center-line": 0.07487325540147884, "driven_lanedir_consec": 0.2709059386019117, "sim_compute_sim_state": 0.04080286622047424, "sim_compute_performance-ego": 0.06528523564338684, "sim_compute_robot_state-ego": 0.06283357739448547}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6399474805974797, "sim_physics": 0.060020944651435405, "survival_time": 1.7000000000000008, "driven_lanedir": 0.3420131807562812, "sim_render-ego": 0.0619127399781171, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17685991175034466, "deviation-heading": 0.4467802714694448, "set_robot_commands": 0.07944966765011058, "deviation-center-line": 0.07943135621788631, "driven_lanedir_consec": 0.3385286882763787, "sim_compute_sim_state": 0.04225371164434096, "sim_compute_performance-ego": 0.06633660372565775, "sim_compute_robot_state-ego": 0.0632695941364064}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5040456419023065, "sim_physics": 0.05862019856770833, "survival_time": 2.9999999999999973, "driven_lanedir": 1.0464264885045251, "sim_render-ego": 0.062396812438964847, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.1730330467224121, "deviation-heading": 0.17294554879163923, "set_robot_commands": 0.07820066610972086, "deviation-center-line": 0.19953979422695187, "driven_lanedir_consec": 1.0464264885045251, "sim_compute_sim_state": 0.04376799662907918, "sim_compute_performance-ego": 0.06637561321258545, "sim_compute_robot_state-ego": 0.06514517466227214}}set_robot_commands_max 0.07944966765011058 set_robot_commands_mean 0.0787732201753393 set_robot_commands_median 0.0786476731300354 set_robot_commands_min 0.07820066610972086 sim_compute_performance-ego_max 0.0682473903478578 sim_compute_performance-ego_mean 0.06605729026973232 sim_compute_performance-ego_median 0.06633660372565775 sim_compute_performance-ego_min 0.0640416084191738 sim_compute_robot_state-ego_max 0.06823523654494175 sim_compute_robot_state-ego_mean 0.06494270242972001 sim_compute_robot_state-ego_median 0.06514517466227214 sim_compute_robot_state-ego_min 0.06283357739448547 sim_compute_sim_state_max 0.04376799662907918 sim_compute_sim_state_mean 0.04261476374566482 sim_compute_sim_state_median 0.04287863694704496 sim_compute_sim_state_min 0.04080286622047424 sim_physics_max 0.061940282583236694 sim_physics_mean 0.06022966955970817 sim_physics_median 0.060020944651435405 sim_physics_min 0.05862019856770833 sim_render-ego_max 0.06684896557830101 sim_render-ego_mean 0.06335610261919825 sim_render-ego_median 0.062396812438964847 sim_render-ego_min 0.061640611061683066 simulation-passed 1 survival_time_max 3.899999999999994 survival_time_mean 2.3099999999999987 survival_time_min 0.8000000000000002
No reset possible 20956step1-simulation success no 2019-04-27 16:00:18+00:00 2019-04-27 16:10:20+00:00 0:10:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20269step1-simulation success no 2019-04-25 11:00:21+00:00 2019-04-25 11:08:19+00:00 0:07:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19937step1-simulation error no 2019-04-25 08:39:05+00:00 2019-04-25 08:39:52+00:00 0:00:47 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 250, in run_episode
sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
error in simulator |Exception while handling a message on topic "episode_start".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "gym_bridge.py", line 209, in on_received_episode_start
|| self.update_observations(context)
|| File "gym_bridge.py", line 281, in update_observations
|| jpg_data = rgb2jpg(obs)
|| File "gym_bridge.py", line 359, in rgb2jpg
|| bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
|| cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
|| > Unsupported depth of input image:
|| > 'VDepth::contains(depth)'
|| > where
|| > 'depth' is 6 (CV_64F)
||
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 135, in main
> physics_dt=config.physics_dt)
> File "experiment_manager.py", line 250, in run_episode
> sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
> others = read_until_over(fpout, timeout=timeout, nickname=nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
> raise RemoteNodeAborted(m)
> zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
>
> error in simulator |Exception while handling a message on topic "episode_start".
> |
> || Traceback (most recent call last):
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
> || handle_message_node(parsed, receiver0, context0)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
> || call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
> || f(**kwargs)
> || File "gym_bridge.py", line 209, in on_received_episode_start
> || self.update_observations(context)
> || File "gym_bridge.py", line 281, in update_observations
> || jpg_data = rgb2jpg(obs)
> || File "gym_bridge.py", line 359, in rgb2jpg
> || bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
> || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
> || > Unsupported depth of input image:
> || > 'VDepth::contains(depth)'
> || > where
> || > 'depth' is 6 (CV_64F)
> ||
> ||
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19876step1-simulation error no 2019-04-25 08:34:22+00:00 2019-04-25 08:35:18+00:00 0:00:56 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 250, in run_episode
sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
error in simulator |Exception while handling a message on topic "episode_start".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "gym_bridge.py", line 209, in on_received_episode_start
|| self.update_observations(context)
|| File "gym_bridge.py", line 274, in update_observations
|| jpg_data = rgb2jpg(obs)
|| File "gym_bridge.py", line 352, in rgb2jpg
|| bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
|| cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
|| > Unsupported depth of input image:
|| > 'VDepth::contains(depth)'
|| > where
|| > 'depth' is 6 (CV_64F)
||
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 135, in main
> physics_dt=config.physics_dt)
> File "experiment_manager.py", line 250, in run_episode
> sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
> others = read_until_over(fpout, timeout=timeout, nickname=nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
> raise RemoteNodeAborted(m)
> zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
>
> error in simulator |Exception while handling a message on topic "episode_start".
> |
> || Traceback (most recent call last):
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
> || handle_message_node(parsed, receiver0, context0)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
> || call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
> || f(**kwargs)
> || File "gym_bridge.py", line 209, in on_received_episode_start
> || self.update_observations(context)
> || File "gym_bridge.py", line 274, in update_observations
> || jpg_data = rgb2jpg(obs)
> || File "gym_bridge.py", line 352, in rgb2jpg
> || bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
> || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
> || > Unsupported depth of input image:
> || > 'VDepth::contains(depth)'
> || > where
> || > 'depth' is 6 (CV_64F)
> ||
> ||
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19302step1-simulation success no 2019-04-24 13:51:34+00:00 2019-04-24 13:57:25+00:00 0:05:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18585step1-simulation success no 2019-04-20 08:20:58+00:00 2019-04-20 08:27:33+00:00 0:06:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18573step1-simulation host-error no 2019-04-20 08:15:40+00:00 2019-04-20 08:20:21+00:00 0:04:41 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
uploaded = upload_files(wd, aws_config)
File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
uploaded = upload(aws_config, toupload)
File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
sha256hex = compute_sha256hex(realfile)
File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
res: bytes = subprocess.check_output(cmd)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2867/step1-simulation-idsc-rudolf-10292-job18573/tmp/tmpnnhxzss3/attempts/ETHZ_autolab_technical_track-2-0.attempt2/drawing.html']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18570step1-simulation success no 2019-04-19 22:27:33+00:00 2019-04-19 22:33:58+00:00 0:06:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Peter Almasi 🇭🇺