Job ID step status up to date date started date completed duration message 22852
step1-simulation success yes 2019-05-17 03:00:58+00:00 2019-05-17 03:08:53+00:00 0:07:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.36592094708219225 survival_time_median 2.5999999999999988 deviation-center-line_median 0.16987818035809085 in-drivable-lane_median 0.05000000000000005
other stats agent_compute-ego_max 0.07544233649969101 agent_compute-ego_mean 0.06975875874859214 agent_compute-ego_median 0.07021189743364362 agent_compute-ego_min 0.06409977491085346 deviation-center-line_max 0.2294363663374862 deviation-center-line_mean 0.14972083567701736 deviation-center-line_min 0.06426934298501713 deviation-heading_max 0.6986268167330368 deviation-heading_mean 0.4280304166285303 deviation-heading_median 0.41847631252347706 deviation-heading_min 0.2596285487829774 driven_any_max 1.2972979671834337 driven_any_mean 0.7173901327940211 driven_any_median 0.7336463183586153 driven_any_min 0.26903550091980144 driven_lanedir_consec_max 0.97716132702229 driven_lanedir_consec_mean 0.5227475277218055 driven_lanedir_consec_min 0.2407721645627201 driven_lanedir_max 0.97716132702229 driven_lanedir_mean 0.5227475277218055 driven_lanedir_median 0.36592094708219225 driven_lanedir_min 0.2407721645627201 in-drivable-lane_max 1.8999999999999944 in-drivable-lane_mean 0.5799999999999983 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.15888397122772646, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06132647688959686, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07021189743364362, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09867015019269056, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0374143123626709, "sim_compute_performance-ego": 0.07139776122402137, "sim_compute_robot_state-ego": 0.07557405216593138, "sim_compute_robot_state-npc0": 0.07096045453783492, "sim_compute_robot_state-npc1": 0.0693918550518197, "sim_compute_robot_state-npc2": 0.06751431209940306, "sim_compute_robot_state-npc3": 0.06642922884981398}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.1846514791250229, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.05720393359661102, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07544233649969101, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.09705163538455965, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.03773318976163864, "sim_compute_performance-ego": 0.06416330486536026, "sim_compute_robot_state-ego": 0.07161182165145874, "sim_compute_robot_state-npc0": 0.07017747312784195, "sim_compute_robot_state-npc1": 0.06657131761312485, "sim_compute_robot_state-npc2": 0.06599271297454834, "sim_compute_robot_state-npc3": 0.06588449329137802}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.1705481089078463, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.05874936855756319, "in-drivable-lane": 0, "agent_compute-ego": 0.06409977491085346, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.08751562466988197, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.03528828345812284, "sim_compute_performance-ego": 0.0654580547259404, "sim_compute_robot_state-ego": 0.06990432739257812, "sim_compute_robot_state-npc0": 0.06671490119053768, "sim_compute_robot_state-npc1": 0.06193419603201059, "sim_compute_robot_state-npc2": 0.06318559554906991, "sim_compute_robot_state-npc3": 0.06105153377239521}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.17521740544226863, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.058234366037512336, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06656772346906764, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.09138465953129594, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.03865647828707131, "sim_compute_performance-ego": 0.0646525941869264, "sim_compute_robot_state-ego": 0.07623565581537062, "sim_compute_robot_state-npc0": 0.06878933342554236, "sim_compute_robot_state-npc1": 0.0685340742911062, "sim_compute_robot_state-npc2": 0.06487546172193302, "sim_compute_robot_state-npc3": 0.06550859892240135}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.16164196105230422, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.05829236620948428, "in-drivable-lane": 0, "agent_compute-ego": 0.07247206142970494, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.09180792172749835, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.035907291230701265, "sim_compute_performance-ego": 0.06959506443568639, "sim_compute_robot_state-ego": 0.06808485303606306, "sim_compute_robot_state-npc0": 0.0637563183194115, "sim_compute_robot_state-npc1": 0.06455160322643462, "sim_compute_robot_state-npc2": 0.06521195457095191, "sim_compute_robot_state-npc3": 0.06523373013450987}}set_robot_commands_max 0.09867015019269056 set_robot_commands_mean 0.0932859983011853 set_robot_commands_median 0.09180792172749835 set_robot_commands_min 0.08751562466988197 sim_compute_performance-ego_max 0.07139776122402137 sim_compute_performance-ego_mean 0.06705335588758696 sim_compute_performance-ego_median 0.0654580547259404 sim_compute_performance-ego_min 0.06416330486536026 sim_compute_robot_state-ego_max 0.07623565581537062 sim_compute_robot_state-ego_mean 0.07228214201228038 sim_compute_robot_state-ego_median 0.07161182165145874 sim_compute_robot_state-ego_min 0.06808485303606306 sim_compute_robot_state-npc0_max 0.07096045453783492 sim_compute_robot_state-npc0_mean 0.06807969612023368 sim_compute_robot_state-npc0_median 0.06878933342554236 sim_compute_robot_state-npc0_min 0.0637563183194115 sim_compute_robot_state-npc1_max 0.0693918550518197 sim_compute_robot_state-npc1_mean 0.06619660924289919 sim_compute_robot_state-npc1_median 0.06657131761312485 sim_compute_robot_state-npc1_min 0.06193419603201059 sim_compute_robot_state-npc2_max 0.06751431209940306 sim_compute_robot_state-npc2_mean 0.06535600738318124 sim_compute_robot_state-npc2_median 0.06521195457095191 sim_compute_robot_state-npc2_min 0.06318559554906991 sim_compute_robot_state-npc3_max 0.06642922884981398 sim_compute_robot_state-npc3_mean 0.06482151699409969 sim_compute_robot_state-npc3_median 0.06550859892240135 sim_compute_robot_state-npc3_min 0.06105153377239521 sim_compute_sim_state_max 0.03865647828707131 sim_compute_sim_state_mean 0.03699991102004099 sim_compute_sim_state_median 0.0374143123626709 sim_compute_sim_state_min 0.03528828345812284 sim_physics_max 0.1846514791250229 sim_physics_mean 0.1701885851510337 sim_physics_median 0.1705481089078463 sim_physics_min 0.15888397122772646 sim_render-ego_max 0.06132647688959686 sim_render-ego_mean 0.058761302258153535 sim_render-ego_median 0.05829236620948428 sim_render-ego_min 0.05720393359661102 simulation-passed 1 survival_time_max 4.6499999999999915 survival_time_mean 2.6899999999999973 survival_time_min 1.0500000000000005
No reset possible 21130
step1-simulation success no 2019-04-27 19:19:58+00:00 2019-04-27 19:26:32+00:00 0:06:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21110
step1-simulation host-error no 2019-04-27 18:59:48+00:00 2019-04-27 19:00:07+00:00 0:00:19 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2645/step1-simulation-ip-172-31-42-167-7357-job21110/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20430
step1-simulation success no 2019-04-25 13:00:20+00:00 2019-04-25 13:09:22+00:00 0:09:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20421
step1-simulation host-error no 2019-04-25 12:52:32+00:00 2019-04-25 13:00:08+00:00 0:07:36 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20421-729659', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20421-729659', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job20421-729659', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20411
step1-simulation timeout no 2019-04-25 12:36:46+00:00 2019-04-25 12:50:50+00:00 0:14:04 Timeout because eval [...] Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19917
step1-simulation error no 2019-04-25 08:37:46+00:00 2019-04-25 08:38:37+00:00 0:00:51 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 250, in run_episode
sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
error in simulator |Exception while handling a message on topic "episode_start".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "gym_bridge.py", line 209, in on_received_episode_start
|| self.update_observations(context)
|| File "gym_bridge.py", line 274, in update_observations
|| jpg_data = rgb2jpg(obs)
|| File "gym_bridge.py", line 352, in rgb2jpg
|| bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
|| cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
|| > Unsupported depth of input image:
|| > 'VDepth::contains(depth)'
|| > where
|| > 'depth' is 6 (CV_64F)
||
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 135, in main
> physics_dt=config.physics_dt)
> File "experiment_manager.py", line 250, in run_episode
> sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
> others = read_until_over(fpout, timeout=timeout, nickname=nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
> raise RemoteNodeAborted(m)
> zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
>
> error in simulator |Exception while handling a message on topic "episode_start".
> |
> || Traceback (most recent call last):
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
> || handle_message_node(parsed, receiver0, context0)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
> || call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
> || f(**kwargs)
> || File "gym_bridge.py", line 209, in on_received_episode_start
> || self.update_observations(context)
> || File "gym_bridge.py", line 274, in update_observations
> || jpg_data = rgb2jpg(obs)
> || File "gym_bridge.py", line 352, in rgb2jpg
> || bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
> || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
> || > Unsupported depth of input image:
> || > 'VDepth::contains(depth)'
> || > where
> || > 'depth' is 6 (CV_64F)
> ||
> ||
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19471
step1-simulation success no 2019-04-24 15:08:27+00:00 2019-04-24 15:17:59+00:00 0:09:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19446
step1-simulation host-error no 2019-04-24 14:57:40+00:00 2019-04-24 15:00:06+00:00 0:02:26 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19446-730830', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19446-730830', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job19446-730830', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18708
step1-simulation success no 2019-04-20 10:37:58+00:00 2019-04-20 10:47:33+00:00 0:09:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18366
step1-simulation success no 2019-04-19 13:27:30+00:00 2019-04-19 13:36:41+00:00 0:09:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18047
step1-simulation success no 2019-04-17 10:47:13+00:00 2019-04-17 10:51:53+00:00 0:04:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible