Job ID step status up to date date started date completed duration message 22817step1-simulation success yes 2019-05-17 02:07:50+00:00 2019-05-17 02:28:07+00:00 0:20:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4690786702157119 survival_time_median 6.699999999999984 deviation-center-line_median 0.43723008973912375 in-drivable-lane_median 0.30000000000000027
other stats agent_compute-ego_max 0.1124172169821603 agent_compute-ego_mean 0.10786089040848408 agent_compute-ego_median 0.10713587999343872 agent_compute-ego_min 0.10383313162284984 deviation-center-line_max 1.1001113356478638 deviation-center-line_mean 0.5500121744977544 deviation-center-line_min 0.22790491168772548 deviation-heading_max 4.765786249064606 deviation-heading_mean 2.47491997496173 deviation-heading_median 2.30847155631943 deviation-heading_min 0.4615150699879939 driven_any_max 2.348942849935891 driven_any_mean 1.1643384083031203 driven_any_median 1.0230267571294585 driven_any_min 0.40439861257061344 driven_lanedir_consec_max 1.3229345330603266 driven_lanedir_consec_mean 0.7484811054738307 driven_lanedir_consec_min 0.3149562081743923 driven_lanedir_max 2.063205888072332 driven_lanedir_mean 0.9371390524751284 driven_lanedir_median 0.5179745881688755 driven_lanedir_min 0.3978460021441807 in-drivable-lane_max 2.6499999999999906 in-drivable-lane_mean 0.6999999999999997 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3356737866289494, "sim_physics": 0.17366333961486816, "survival_time": 8.74999999999999, "driven_lanedir": 1.237590113774542, "sim_render-ego": 0.08208147321428572, "in-drivable-lane": 0, "agent_compute-ego": 0.1124172169821603, "deviation-heading": 2.6693194626371435, "set_robot_commands": 0.14752900532313756, "deviation-center-line": 0.7028691875713812, "driven_lanedir_consec": 1.237590113774542, "sim_compute_sim_state": 0.05027055604117257, "sim_compute_performance-ego": 0.0932267393384661, "sim_compute_robot_state-ego": 0.10942725317818776}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7096500352506895, "sim_physics": 0.1762840371382864, "survival_time": 4.749999999999991, "driven_lanedir": 0.5179745881688755, "sim_render-ego": 0.07936466618588096, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.10678895649157072, "deviation-heading": 2.30847155631943, "set_robot_commands": 0.1438944515429045, "deviation-center-line": 0.43723008973912375, "driven_lanedir_consec": 0.3149562081743923, "sim_compute_sim_state": 0.04925867381848787, "sim_compute_performance-ego": 0.09145562523289733, "sim_compute_robot_state-ego": 0.10659711235447934}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.40439861257061344, "sim_physics": 0.15296790474339536, "survival_time": 2.849999999999998, "driven_lanedir": 0.3978460021441807, "sim_render-ego": 0.07481411883705541, "in-drivable-lane": 0, "agent_compute-ego": 0.10383313162284984, "deviation-heading": 0.4615150699879939, "set_robot_commands": 0.1307845157489442, "deviation-center-line": 0.28194534784267833, "driven_lanedir_consec": 0.3978460021441807, "sim_compute_sim_state": 0.0476942731623064, "sim_compute_performance-ego": 0.08369564173514382, "sim_compute_robot_state-ego": 0.09850845838847912}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0230267571294585, "sim_physics": 0.17613901131188692, "survival_time": 6.699999999999984, "driven_lanedir": 0.4690786702157119, "sim_render-ego": 0.07964091692397844, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.10912926695240076, "deviation-heading": 2.1695075367994776, "set_robot_commands": 0.1397257811987578, "deviation-center-line": 0.22790491168772548, "driven_lanedir_consec": 0.4690786702157119, "sim_compute_sim_state": 0.04884407235615289, "sim_compute_performance-ego": 0.08942116552324438, "sim_compute_robot_state-ego": 0.1050582768312141}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.348942849935891, "sim_physics": 0.16706646998723348, "survival_time": 14.950000000000076, "driven_lanedir": 2.063205888072332, "sim_render-ego": 0.07924894253412883, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.10713587999343872, "deviation-heading": 4.765786249064606, "set_robot_commands": 0.14324581305185954, "deviation-center-line": 1.1001113356478638, "driven_lanedir_consec": 1.3229345330603266, "sim_compute_sim_state": 0.05035711685816447, "sim_compute_performance-ego": 0.09196914990743, "sim_compute_robot_state-ego": 0.10849599997202557}}set_robot_commands_max 0.14752900532313756 set_robot_commands_mean 0.14103591337312074 set_robot_commands_median 0.14324581305185954 set_robot_commands_min 0.1307845157489442 sim_compute_performance-ego_max 0.0932267393384661 sim_compute_performance-ego_mean 0.08995366434743632 sim_compute_performance-ego_median 0.09145562523289733 sim_compute_performance-ego_min 0.08369564173514382 sim_compute_robot_state-ego_max 0.10942725317818776 sim_compute_robot_state-ego_mean 0.10561742014487718 sim_compute_robot_state-ego_median 0.10659711235447934 sim_compute_robot_state-ego_min 0.09850845838847912 sim_compute_sim_state_max 0.05035711685816447 sim_compute_sim_state_mean 0.04928493844725684 sim_compute_sim_state_median 0.04925867381848787 sim_compute_sim_state_min 0.0476942731623064 sim_physics_max 0.1762840371382864 sim_physics_mean 0.1692241525591341 sim_physics_median 0.17366333961486816 sim_physics_min 0.15296790474339536 sim_render-ego_max 0.08208147321428572 sim_render-ego_mean 0.07903002353906588 sim_render-ego_median 0.07936466618588096 sim_render-ego_min 0.07481411883705541 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.600000000000008 survival_time_min 2.849999999999998
No reset possible 21091step1-simulation success no 2019-04-27 18:08:25+00:00 2019-04-27 18:20:55+00:00 0:12:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21074step1-simulation host-error no 2019-04-27 17:49:31+00:00 2019-04-27 18:00:05+00:00 0:10:34 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2704/step1-simulation-ip-172-31-42-167-7357-job21074/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20396step1-simulation success no 2019-04-25 12:14:32+00:00 2019-04-25 12:34:54+00:00 0:20:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20370step1-simulation host-error no 2019-04-25 11:55:20+00:00 2019-04-25 12:00:08+00:00 0:04:48 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20370-313512', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20370-313512', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job20370-313512', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19916step1-simulation error no 2019-04-25 08:37:41+00:00 2019-04-25 08:38:32+00:00 0:00:51 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 250, in run_episode
sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
error in simulator |Exception while handling a message on topic "episode_start".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "gym_bridge.py", line 209, in on_received_episode_start
|| self.update_observations(context)
|| File "gym_bridge.py", line 281, in update_observations
|| jpg_data = rgb2jpg(obs)
|| File "gym_bridge.py", line 359, in rgb2jpg
|| bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
|| cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
|| > Unsupported depth of input image:
|| > 'VDepth::contains(depth)'
|| > where
|| > 'depth' is 6 (CV_64F)
||
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 135, in main
> physics_dt=config.physics_dt)
> File "experiment_manager.py", line 250, in run_episode
> sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
> others = read_until_over(fpout, timeout=timeout, nickname=nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
> raise RemoteNodeAborted(m)
> zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
>
> error in simulator |Exception while handling a message on topic "episode_start".
> |
> || Traceback (most recent call last):
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
> || handle_message_node(parsed, receiver0, context0)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
> || call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
> || f(**kwargs)
> || File "gym_bridge.py", line 209, in on_received_episode_start
> || self.update_observations(context)
> || File "gym_bridge.py", line 281, in update_observations
> || jpg_data = rgb2jpg(obs)
> || File "gym_bridge.py", line 359, in rgb2jpg
> || bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
> || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
> || > Unsupported depth of input image:
> || > 'VDepth::contains(depth)'
> || > where
> || > 'depth' is 6 (CV_64F)
> ||
> ||
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19908step1-simulation error no 2019-04-25 08:36:56+00:00 2019-04-25 08:38:01+00:00 0:01:05 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 250, in run_episode
sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
error in simulator |Exception while handling a message on topic "episode_start".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "gym_bridge.py", line 209, in on_received_episode_start
|| self.update_observations(context)
|| File "gym_bridge.py", line 274, in update_observations
|| jpg_data = rgb2jpg(obs)
|| File "gym_bridge.py", line 352, in rgb2jpg
|| bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
|| cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
|| > Unsupported depth of input image:
|| > 'VDepth::contains(depth)'
|| > where
|| > 'depth' is 6 (CV_64F)
||
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 135, in main
> physics_dt=config.physics_dt)
> File "experiment_manager.py", line 250, in run_episode
> sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
> others = read_until_over(fpout, timeout=timeout, nickname=nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
> raise RemoteNodeAborted(m)
> zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
>
> error in simulator |Exception while handling a message on topic "episode_start".
> |
> || Traceback (most recent call last):
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
> || handle_message_node(parsed, receiver0, context0)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
> || call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
> || f(**kwargs)
> || File "gym_bridge.py", line 209, in on_received_episode_start
> || self.update_observations(context)
> || File "gym_bridge.py", line 274, in update_observations
> || jpg_data = rgb2jpg(obs)
> || File "gym_bridge.py", line 352, in rgb2jpg
> || bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
> || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
> || > Unsupported depth of input image:
> || > 'VDepth::contains(depth)'
> || > where
> || > 'depth' is 6 (CV_64F)
> ||
> ||
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19409step1-simulation success no 2019-04-24 14:29:41+00:00 2019-04-24 14:47:34+00:00 0:17:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18672step1-simulation error no 2019-04-20 09:38:00+00:00 2019-04-20 09:58:52+00:00 0:20:52 Waited 1204 seconds [...] Waited 1204 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18263step1-simulation success no 2019-04-19 12:05:14+00:00 2019-04-19 12:18:55+00:00 0:13:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18089step1-simulation success no 2019-04-17 14:58:56+00:00 2019-04-17 15:08:31+00:00 0:09:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Rami Al-Naim 🇷🇺