Duckietown Challenges Home Challenges Submissions

Submission 2648

Submission2648
Competingyes
Challengeaido2-LFVI-sim-testing
UserEgor Zamotaev
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22851
Next
User labelchallenge-aido_LF-template-ros - Template solution using ROS
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22851step1-simulationsuccessyes0:27:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2875407694053156
survival_time_median2.849999999999998
deviation-center-line_median0.11031194850197353
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.08632995771325153
agent_compute-ego_mean0.07258555104347192
agent_compute-ego_median0.07364971497479607
agent_compute-ego_min0.05682149268033212
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.13746050030700233
deviation-center-line_min0.07113819587235681
deviation-heading_max1.4854398920276677
deviation-heading_mean0.7236995121312619
deviation-heading_median0.6953408166028192
deviation-heading_min0.3118646573709166
driven_any_max1.934434121703833
driven_any_mean0.806757806634148
driven_any_median0.8072381933001392
driven_any_min0.20912585880423715
driven_lanedir_consec_max0.7222251056746308
driven_lanedir_consec_mean0.3962831867516217
driven_lanedir_consec_min0.1917983424483971
driven_lanedir_max0.7287863177121016
driven_lanedir_mean0.3975640776898326
driven_lanedir_median0.2875407694053156
driven_lanedir_min0.1917983424483971
in-drivable-lane_max4.04999999999999
in-drivable-lane_mean1.2133333333333305
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.2208167673593544, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.06268394711505935, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07430597672979515, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.09781136282955308, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.03910027354596609, "sim_compute_performance-ego": 0.07030214459063058, "sim_compute_robot_state-ego": 0.07872608483555806, "sim_compute_robot_state-npc0": 0.07072179863251836, "sim_compute_robot_state-npc1": 0.07518886945333826, "sim_compute_robot_state-npc2": 0.06789047746773226, "sim_compute_robot_state-npc3": 0.06894940066050334}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.19459955780594437, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06086780406810619, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0828678254727964, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.09315087177135328, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.03666593410350658, "sim_compute_performance-ego": 0.06677443892867477, "sim_compute_robot_state-ego": 0.07142140247203686, "sim_compute_robot_state-npc0": 0.06709367257577402, "sim_compute_robot_state-npc1": 0.06923399148163972, "sim_compute_robot_state-npc2": 0.06727996578922978, "sim_compute_robot_state-npc3": 0.0709986686706543}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.21615739663441977, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06561717314597888, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07435044875511757, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.10027464230855306, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.04094785910386305, "sim_compute_performance-ego": 0.07206605642269819, "sim_compute_robot_state-ego": 0.07668853111756153, "sim_compute_robot_state-npc0": 0.07139811454675137, "sim_compute_robot_state-npc1": 0.07054560612409543, "sim_compute_robot_state-npc2": 0.06968988516391852, "sim_compute_robot_state-npc3": 0.0709447524486444}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.16530179140860574, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.05005222036127459, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.05682149268033212, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.07452575365702312, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.03095547776473196, "sim_compute_performance-ego": 0.05155316570348907, "sim_compute_robot_state-ego": 0.05490991525482713, "sim_compute_robot_state-npc0": 0.05414606813798871, "sim_compute_robot_state-npc1": 0.052671875870018675, "sim_compute_robot_state-npc2": 0.05361538602594744, "sim_compute_robot_state-npc3": 0.052708458482173454}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.26057151089543884, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.07012398346610692, "in-drivable-lane": 0, "agent_compute-ego": 0.08632995771325153, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.11307873933211617, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.04470136891240659, "sim_compute_performance-ego": 0.08233482941337254, "sim_compute_robot_state-ego": 0.09955243442369544, "sim_compute_robot_state-npc0": 0.07949352264404297, "sim_compute_robot_state-npc1": 0.0775585589201554, "sim_compute_robot_state-npc2": 0.0762957179028055, "sim_compute_robot_state-npc3": 0.07926375969596532}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.21686979602364936, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06413366981581145, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.07361782064624861, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.10138054688771564, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.04110824360566981, "sim_compute_performance-ego": 0.0718316540998571, "sim_compute_robot_state-ego": 0.07901183062908697, "sim_compute_robot_state-npc0": 0.07137980180628159, "sim_compute_robot_state-npc1": 0.07280653598261815, "sim_compute_robot_state-npc2": 0.07223974255954518, "sim_compute_robot_state-npc3": 0.0718833184709736}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.20806645495550977, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.06182538781847272, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.07366857528686524, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.09940426009041922, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.03839561939239502, "sim_compute_performance-ego": 0.06624725546155658, "sim_compute_robot_state-ego": 0.07188105583190918, "sim_compute_robot_state-npc0": 0.07021537167685372, "sim_compute_robot_state-npc1": 0.06950015681130546, "sim_compute_robot_state-npc2": 0.07012502806527274, "sim_compute_robot_state-npc3": 0.06942883389336722}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.20894192342888815, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.06547255058811136, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07543560250164712, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.10080540996708282, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.03899189217449867, "sim_compute_performance-ego": 0.07018102685066119, "sim_compute_robot_state-ego": 0.07711496745070366, "sim_compute_robot_state-npc0": 0.07080989667814072, "sim_compute_robot_state-npc1": 0.07297921507325891, "sim_compute_robot_state-npc2": 0.06947513149209218, "sim_compute_robot_state-npc3": 0.07072316783748261}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.20094177889269452, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06345253766969193, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.07120721839195074, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.09992891134217728, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.03913887156996616, "sim_compute_performance-ego": 0.0688749912173249, "sim_compute_robot_state-ego": 0.07422647365303926, "sim_compute_robot_state-npc0": 0.07162331425866415, "sim_compute_robot_state-npc1": 0.07215206013169399, "sim_compute_robot_state-npc2": 0.07188758461974389, "sim_compute_robot_state-npc3": 0.07284548393515654}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.18085241317749023, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.049974294809194714, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.05692987258617695, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.07175432718717135, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.029191081340496357, "sim_compute_performance-ego": 0.051044161503131576, "sim_compute_robot_state-ego": 0.056077269407419056, "sim_compute_robot_state-npc0": 0.05365423972790058, "sim_compute_robot_state-npc1": 0.05320336268498348, "sim_compute_robot_state-npc2": 0.05419428531940167, "sim_compute_robot_state-npc3": 0.05005870415614201}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.2004930019378662, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.06235786437988281, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0715472380320231, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.09738000869750976, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.03913875579833984, "sim_compute_performance-ego": 0.06630342483520507, "sim_compute_robot_state-ego": 0.0718217118581136, "sim_compute_robot_state-npc0": 0.06972095171610514, "sim_compute_robot_state-npc1": 0.06911776224772136, "sim_compute_robot_state-npc2": 0.07022971153259278, "sim_compute_robot_state-npc3": 0.07081513086954752}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.2173393340337844, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06691268512180873, "in-drivable-lane": 0, "agent_compute-ego": 0.07051161357334682, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.0989178702944801, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.039454108192807154, "sim_compute_performance-ego": 0.06593296641395205, "sim_compute_robot_state-ego": 0.06990030833653041, "sim_compute_robot_state-npc0": 0.07706495693751744, "sim_compute_robot_state-npc1": 0.0714270727975028, "sim_compute_robot_state-npc2": 0.0713616893405006, "sim_compute_robot_state-npc3": 0.07125240280514672}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.24641562617102333, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.06505821471990542, "in-drivable-lane": 1.15, "agent_compute-ego": 0.07174383207809093, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.10319226287132086, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.04028874219850053, "sim_compute_performance-ego": 0.07326821948206702, "sim_compute_robot_state-ego": 0.08584097374317258, "sim_compute_robot_state-npc0": 0.0761379086694052, "sim_compute_robot_state-npc1": 0.07427073079486225, "sim_compute_robot_state-npc2": 0.0721655058306317, "sim_compute_robot_state-npc3": 0.07203166429386583}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.23354137795312063, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.06516517911638532, "in-drivable-lane": 0, "agent_compute-ego": 0.07579607622964042, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.10159674712589808, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.04076665639877319, "sim_compute_performance-ego": 0.0705450006893703, "sim_compute_robot_state-ego": 0.0794705833707537, "sim_compute_robot_state-npc0": 0.07439419201442174, "sim_compute_robot_state-npc1": 0.07362354653222221, "sim_compute_robot_state-npc2": 0.07857108967644828, "sim_compute_robot_state-npc3": 0.07626925195966448}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.2203141988492479, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.06269790612015069, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.07364971497479607, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.09741551735821892, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.042307619955025466, "sim_compute_performance-ego": 0.07099174050723805, "sim_compute_robot_state-ego": 0.06981645378411985, "sim_compute_robot_state-npc0": 0.07214664945415422, "sim_compute_robot_state-npc1": 0.07022865145814185, "sim_compute_robot_state-npc2": 0.0721892001582127, "sim_compute_robot_state-npc3": 0.07289977634654325}}
set_robot_commands_max0.11307873933211617
set_robot_commands_mean0.09670781544803952
set_robot_commands_median0.09940426009041922
set_robot_commands_min0.07175432718717135
sim_compute_performance-ego_max0.08233482941337254
sim_compute_performance-ego_mean0.06788340507461528
sim_compute_performance-ego_median0.07018102685066119
sim_compute_performance-ego_min0.051044161503131576
sim_compute_robot_state-ego_max0.09955243442369544
sim_compute_robot_state-ego_mean0.07443066641123515
sim_compute_robot_state-ego_median0.07422647365303926
sim_compute_robot_state-ego_min0.05490991525482713
sim_compute_robot_state-npc0_max0.07949352264404297
sim_compute_robot_state-npc0_mean0.07000003063176802
sim_compute_robot_state-npc0_median0.07137980180628159
sim_compute_robot_state-npc0_min0.05365423972790058
sim_compute_robot_state-npc1_max0.0775585589201554
sim_compute_robot_state-npc1_mean0.0696338664242372
sim_compute_robot_state-npc1_median0.0714270727975028
sim_compute_robot_state-npc1_min0.052671875870018675
sim_compute_robot_state-npc2_max0.07857108967644828
sim_compute_robot_state-npc2_mean0.06914736006293834
sim_compute_robot_state-npc2_median0.07022971153259278
sim_compute_robot_state-npc2_min0.05361538602594744
sim_compute_robot_state-npc3_max0.07926375969596532
sim_compute_robot_state-npc3_mean0.06940485163505537
sim_compute_robot_state-npc3_median0.0709986686706543
sim_compute_robot_state-npc3_min0.05005870415614201
sim_compute_sim_state_max0.04470136891240659
sim_compute_sim_state_mean0.0387435002704631
sim_compute_sim_state_median0.03913887156996616
sim_compute_sim_state_min0.029191081340496357
sim_physics_max0.26057151089543884
sim_physics_mean0.21274819530180253
sim_physics_median0.21615739663441977
sim_physics_min0.16530179140860574
sim_render-ego_max0.07012398346610692
sim_render-ego_mean0.06242636122106273
sim_render-ego_median0.06345253766969193
sim_render-ego_min0.049974294809194714
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean3.043333333333329
survival_time_min1.0500000000000005
No reset possible
21715step1-simulationerrorno0:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21709step1-simulationhost-errorno0:28:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2648/step1-simulation-ip-172-31-38-104-5376-job21709/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21705step1-simulationerrorno0:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21109step1-simulationsuccessno0:19:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20437step1-simulationsuccessno0:10:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20426step1-simulationhost-errorno0:00:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20426-764898', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20426-764898', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20426-764898', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20410step1-simulationtimeoutno0:15:49
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20075step1-simulationsuccessno0:15:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19830step1-simulationsuccessno0:09:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19787step1-simulationsuccessno0:09:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19786step1-simulationsuccessno0:08:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19769step1-simulationhost-errorno0:05:56
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19769-817479', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19769-817479', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19769-817479', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19464step1-simulationsuccessno0:10:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19445step1-simulationhost-errorno0:03:33
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19445-465850', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19445-465850', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19445-465850', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18707step1-simulationsuccessno0:09:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18365step1-simulationsuccessno0:09:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18049step1-simulationsuccessno0:04:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible