Job ID step status up to date date started date completed duration message 22870
step1-simulation success yes 2019-05-17 03:25:04+00:00 2019-05-17 03:37:08+00:00 0:12:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.2047179735285702 survival_time_median 14.950000000000076 deviation-center-line_median 0.387887210596401 in-drivable-lane_median 1.2999999999999998
other stats agent_compute-ego_max 0.08128599188793664 agent_compute-ego_mean 0.08075380373153525 agent_compute-ego_median 0.08055917819341024 agent_compute-ego_min 0.0803881523877206 deviation-center-line_max 0.7567448241113871 deviation-center-line_mean 0.45188386673954273 deviation-center-line_min 0.20973936054620676 deviation-heading_max 2.730052148382567 deviation-heading_mean 1.8316575392778272 deviation-heading_median 1.6033474770558855 deviation-heading_min 1.0827259728141294 driven_any_max 3.1435521190582616 driven_any_mean 2.439026555216875 driven_any_median 2.7932338466706583 driven_any_min 1.6032262160278477 driven_lanedir_consec_max 3.128556391011591 driven_lanedir_consec_mean 2.169636264922683 driven_lanedir_consec_min 1.248590441428972 driven_lanedir_max 3.128556391011591 driven_lanedir_mean 2.1707743283451775 driven_lanedir_median 2.2047179735285702 driven_lanedir_min 1.2542807585414442 in-drivable-lane_max 2.9999999999999893 in-drivable-lane_mean 1.2799999999999978 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.7932338466706583, "sim_physics": 0.03968904574712118, "survival_time": 14.950000000000076, "driven_lanedir": 2.2047179735285702, "sim_render-ego": 0.03284593343734741, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.08105300982793172, "deviation-heading": 2.4472602070364977, "set_robot_commands": 0.04948453267415365, "deviation-center-line": 0.5763065820447865, "driven_lanedir_consec": 2.2047179735285702, "sim_compute_sim_state": 0.020168079535166424, "sim_compute_performance-ego": 0.03507746934890747, "sim_compute_robot_state-ego": 0.03708443959554037}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.1435521190582616, "sim_physics": 0.03766788085301717, "survival_time": 14.950000000000076, "driven_lanedir": 3.128556391011591, "sim_render-ego": 0.03181162118911743, "in-drivable-lane": 0, "agent_compute-ego": 0.08055917819341024, "deviation-heading": 1.2949018911000556, "set_robot_commands": 0.04910489479700724, "deviation-center-line": 0.387887210596401, "driven_lanedir_consec": 3.128556391011591, "sim_compute_sim_state": 0.020180350144704182, "sim_compute_performance-ego": 0.035196402072906495, "sim_compute_robot_state-ego": 0.03707608540852864}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9850147294870277, "sim_physics": 0.03953489065170288, "survival_time": 14.950000000000076, "driven_lanedir": 2.9618686891784956, "sim_render-ego": 0.03249676783879598, "in-drivable-lane": 0, "agent_compute-ego": 0.08048268636067708, "deviation-heading": 1.6033474770558855, "set_robot_commands": 0.050098876953125, "deviation-center-line": 0.7567448241113871, "driven_lanedir_consec": 2.9618686891784956, "sim_compute_sim_state": 0.020256613890329997, "sim_compute_performance-ego": 0.03530977090199788, "sim_compute_robot_state-ego": 0.036726176738739014}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6032262160278477, "sim_physics": 0.03830061287715517, "survival_time": 8.699999999999989, "driven_lanedir": 1.2542807585414442, "sim_render-ego": 0.03214742534462063, "in-drivable-lane": 1.2999999999999998, "agent_compute-ego": 0.08128599188793664, "deviation-heading": 2.730052148382567, "set_robot_commands": 0.049446906166515134, "deviation-center-line": 0.3287413563989324, "driven_lanedir_consec": 1.248590441428972, "sim_compute_sim_state": 0.020128447433997845, "sim_compute_performance-ego": 0.03529350236914624, "sim_compute_robot_state-ego": 0.03702182742370956}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6701058648405809, "sim_physics": 0.03935129966961562, "survival_time": 8.449999999999985, "driven_lanedir": 1.3044478294657864, "sim_render-ego": 0.032391845827271955, "in-drivable-lane": 2.0999999999999996, "agent_compute-ego": 0.0803881523877206, "deviation-heading": 1.0827259728141294, "set_robot_commands": 0.04934476395330486, "deviation-center-line": 0.20973936054620676, "driven_lanedir_consec": 1.3044478294657864, "sim_compute_sim_state": 0.02014771438914643, "sim_compute_performance-ego": 0.034906631390723954, "sim_compute_robot_state-ego": 0.037079389278705306}}set_robot_commands_max 0.050098876953125 set_robot_commands_mean 0.04949599490882118 set_robot_commands_median 0.049446906166515134 set_robot_commands_min 0.04910489479700724 sim_compute_performance-ego_max 0.03530977090199788 sim_compute_performance-ego_mean 0.035156755216736404 sim_compute_performance-ego_median 0.035196402072906495 sim_compute_performance-ego_min 0.034906631390723954 sim_compute_robot_state-ego_max 0.03708443959554037 sim_compute_robot_state-ego_mean 0.03699758368904458 sim_compute_robot_state-ego_median 0.03707608540852864 sim_compute_robot_state-ego_min 0.036726176738739014 sim_compute_sim_state_max 0.020256613890329997 sim_compute_sim_state_mean 0.02017624107866898 sim_compute_sim_state_median 0.020168079535166424 sim_compute_sim_state_min 0.020128447433997845 sim_physics_max 0.03968904574712118 sim_physics_mean 0.0389087459597224 sim_physics_median 0.03935129966961562 sim_physics_min 0.03766788085301717 sim_render-ego_max 0.03284593343734741 sim_render-ego_mean 0.03233871872743068 sim_render-ego_median 0.032391845827271955 sim_render-ego_min 0.03181162118911743 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.400000000000045 survival_time_min 8.449999999999985
No reset possible 21177
step1-simulation success no 2019-04-27 20:05:56+00:00 2019-04-27 20:23:16+00:00 0:17:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21145
step1-simulation host-error no 2019-04-27 19:47:05+00:00 2019-04-27 20:00:12+00:00 0:13:07 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2601/step1-simulation-ip-172-31-25-98-2062-job21145/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20451
step1-simulation success no 2019-04-25 13:21:22+00:00 2019-04-25 13:43:10+00:00 0:21:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19961
step1-simulation error no 2019-04-25 08:40:58+00:00 2019-04-25 08:42:02+00:00 0:01:04 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 250, in run_episode
sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
error in simulator |Exception while handling a message on topic "episode_start".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "gym_bridge.py", line 209, in on_received_episode_start
|| self.update_observations(context)
|| File "gym_bridge.py", line 281, in update_observations
|| jpg_data = rgb2jpg(obs)
|| File "gym_bridge.py", line 359, in rgb2jpg
|| bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
|| cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
|| > Unsupported depth of input image:
|| > 'VDepth::contains(depth)'
|| > where
|| > 'depth' is 6 (CV_64F)
||
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 135, in main
> physics_dt=config.physics_dt)
> File "experiment_manager.py", line 250, in run_episode
> sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
> others = read_until_over(fpout, timeout=timeout, nickname=nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
> raise RemoteNodeAborted(m)
> zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
>
> error in simulator |Exception while handling a message on topic "episode_start".
> |
> || Traceback (most recent call last):
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
> || handle_message_node(parsed, receiver0, context0)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
> || call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
> || f(**kwargs)
> || File "gym_bridge.py", line 209, in on_received_episode_start
> || self.update_observations(context)
> || File "gym_bridge.py", line 281, in update_observations
> || jpg_data = rgb2jpg(obs)
> || File "gym_bridge.py", line 359, in rgb2jpg
> || bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
> || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
> || > Unsupported depth of input image:
> || > 'VDepth::contains(depth)'
> || > where
> || > 'depth' is 6 (CV_64F)
> ||
> ||
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19487
step1-simulation success no 2019-04-24 15:20:12+00:00 2019-04-24 15:34:31+00:00 0:14:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18736
step1-simulation success no 2019-04-20 11:13:12+00:00 2019-04-20 11:30:51+00:00 0:17:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18388
step1-simulation success no 2019-04-19 13:54:35+00:00 2019-04-19 14:06:51+00:00 0:12:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18023
step1-simulation success no 2019-04-17 03:45:13+00:00 2019-04-17 04:02:41+00:00 0:17:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible