Evaluator 797

step1-simulation

host-error

2019-04-26 21:45:17+00:00

2019-04-26 22:00:05+00:00

0:14:48

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20705-946339', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20705-946339', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20705-946339', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20703

3099

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 20:22:23+00:00

2019-04-26 20:39:34+00:00

0:17:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6663902113545535
survival_time_median	12.800000000000049
deviation-center-line_median	0.5829013833848496
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1207050420343876
agent_compute-ego_mean	0.12021225838323188
agent_compute-ego_median	0.12001629023588906
agent_compute-ego_min	0.11988096970778243
deviation-center-line_max	1.030051653101152
deviation-center-line_mean	0.724286489425449
deviation-center-line_min	0.48313434764824753
deviation-heading_max	3.732810632808945
deviation-heading_mean	1.860627458487602
deviation-heading_median	1.2503791372855322
deviation-heading_min	1.2340259003919185
driven_any_max	1.2111620787950896
driven_any_mean	0.8784693723787289
driven_any_median	1.0236971602685327
driven_any_min	0.44457140109264065
driven_lanedir_consec_max	1.1858991830630825
driven_lanedir_consec_mean	0.7907930875568365
driven_lanedir_consec_min	0.43447110359073793
driven_lanedir_max	1.1858991830630825
driven_lanedir_mean	0.7907930875568365
driven_lanedir_median	0.6663902113545535
driven_lanedir_min	0.43447110359073793
in-drivable-lane_max	3.2000000000000455
in-drivable-lane_mean	0.6400000000000091
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0236971602685327, "sim_physics": 0.08800943475216627, "survival_time": 12.800000000000049, "driven_lanedir": 0.6663902113545535, "sim_render-ego": 0.034926061518490314, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.1207050420343876, "deviation-heading": 3.732810632808945, "set_robot_commands": 0.054696827195584774, "deviation-center-line": 0.5829013833848496, "driven_lanedir_consec": 0.6663902113545535, "sim_compute_sim_state": 0.02237644698470831, "sim_compute_performance-ego": 0.03891752474009991, "sim_compute_robot_state-ego": 0.04035548772662878, "sim_compute_robot_state-npc0": 0.0402712095528841, "sim_compute_robot_state-npc1": 0.03924635984003544, "sim_compute_robot_state-npc2": 0.03922051843255758, "sim_compute_robot_state-npc3": 0.03895727265626192}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5047489359371492, "sim_physics": 0.08515329508818398, "survival_time": 6.449999999999985, "driven_lanedir": 0.48312317516091285, "sim_render-ego": 0.034896471703699396, "in-drivable-lane": 0, "agent_compute-ego": 0.12001629023588906, "deviation-heading": 1.837807297786273, "set_robot_commands": 0.05379189816556235, "deviation-center-line": 0.5161538582541955, "driven_lanedir_consec": 0.48312317516091285, "sim_compute_sim_state": 0.02263225326242373, "sim_compute_performance-ego": 0.03819077883579934, "sim_compute_robot_state-ego": 0.03984497683916905, "sim_compute_robot_state-npc0": 0.04134187957113104, "sim_compute_robot_state-npc1": 0.039311830387559046, "sim_compute_robot_state-npc2": 0.03886355355728504, "sim_compute_robot_state-npc3": 0.0385234744049782}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2111620787950896, "sim_physics": 0.08862102746963502, "survival_time": 14.950000000000076, "driven_lanedir": 1.1858991830630825, "sim_render-ego": 0.035063944657643634, "in-drivable-lane": 0, "agent_compute-ego": 0.12048453092575072, "deviation-heading": 1.2481143241653423, "set_robot_commands": 0.05349385976791382, "deviation-center-line": 1.030051653101152, "driven_lanedir_consec": 1.1858991830630825, "sim_compute_sim_state": 0.022154022057851157, "sim_compute_performance-ego": 0.03784067630767822, "sim_compute_robot_state-ego": 0.040313825607299805, "sim_compute_robot_state-npc0": 0.03990421056747437, "sim_compute_robot_state-npc1": 0.03881690343221029, "sim_compute_robot_state-npc2": 0.03834736426671346, "sim_compute_robot_state-npc3": 0.03870443820953369}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2081672858002317, "sim_physics": 0.08933109680811564, "survival_time": 14.950000000000076, "driven_lanedir": 1.1840817646148962, "sim_render-ego": 0.03519848426183065, "in-drivable-lane": 0, "agent_compute-ego": 0.11997445901234945, "deviation-heading": 1.2340259003919185, "set_robot_commands": 0.05322498639424642, "deviation-center-line": 1.0091912047388003, "driven_lanedir_consec": 1.1840817646148962, "sim_compute_sim_state": 0.02223114808400472, "sim_compute_performance-ego": 0.039248643716176354, "sim_compute_robot_state-ego": 0.03970639149347941, "sim_compute_robot_state-npc0": 0.039494134585062665, "sim_compute_robot_state-npc1": 0.03882833878199259, "sim_compute_robot_state-npc2": 0.03846292416254679, "sim_compute_robot_state-npc3": 0.03846283753712972}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.44457140109264065, "sim_physics": 0.07476936038742718, "survival_time": 5.849999999999987, "driven_lanedir": 0.43447110359073793, "sim_render-ego": 0.03477037869966947, "in-drivable-lane": 0, "agent_compute-ego": 0.11988096970778243, "deviation-heading": 1.2503791372855322, "set_robot_commands": 0.053003885807135165, "deviation-center-line": 0.48313434764824753, "driven_lanedir_consec": 0.43447110359073793, "sim_compute_sim_state": 0.022081187647632044, "sim_compute_performance-ego": 0.037773332025250815, "sim_compute_robot_state-ego": 0.03970511958130405, "sim_compute_robot_state-npc0": 0.03964829444885254, "sim_compute_robot_state-npc1": 0.03868438239790436, "sim_compute_robot_state-npc2": 0.04009256199893788, "sim_compute_robot_state-npc3": 0.03828544494433281}}
set_robot_commands_max	0.054696827195584774
set_robot_commands_mean	0.053642291466088496
set_robot_commands_median	0.05349385976791382
set_robot_commands_min	0.053003885807135165
sim_compute_performance-ego_max	0.039248643716176354
sim_compute_performance-ego_mean	0.03839419112500093
sim_compute_performance-ego_median	0.03819077883579934
sim_compute_performance-ego_min	0.037773332025250815
sim_compute_robot_state-ego_max	0.04035548772662878
sim_compute_robot_state-ego_mean	0.03998516024957622
sim_compute_robot_state-ego_median	0.03984497683916905
sim_compute_robot_state-ego_min	0.03970511958130405
sim_compute_robot_state-npc0_max	0.04134187957113104
sim_compute_robot_state-npc0_mean	0.040131945745080944
sim_compute_robot_state-npc0_median	0.03990421056747437
sim_compute_robot_state-npc0_min	0.039494134585062665
sim_compute_robot_state-npc1_max	0.039311830387559046
sim_compute_robot_state-npc1_mean	0.038977562967940346
sim_compute_robot_state-npc1_median	0.03882833878199259
sim_compute_robot_state-npc1_min	0.03868438239790436
sim_compute_robot_state-npc2_max	0.04009256199893788
sim_compute_robot_state-npc2_mean	0.03899738448360815
sim_compute_robot_state-npc2_median	0.03886355355728504
sim_compute_robot_state-npc2_min	0.03834736426671346
sim_compute_robot_state-npc3_max	0.03895727265626192
sim_compute_robot_state-npc3_mean	0.03858669355044726
sim_compute_robot_state-npc3_median	0.0385234744049782
sim_compute_robot_state-npc3_min	0.03828544494433281
sim_compute_sim_state_max	0.02263225326242373
sim_compute_sim_state_mean	0.022295011607323993
sim_compute_sim_state_median	0.02223114808400472
sim_compute_sim_state_min	0.022081187647632044
sim_physics_max	0.08933109680811564
sim_physics_mean	0.08517684290110561
sim_physics_median	0.08800943475216627
sim_physics_min	0.07476936038742718
sim_render-ego_max	0.03519848426183065
sim_render-ego_mean	0.03497106816826669
sim_render-ego_median	0.034926061518490314
sim_render-ego_min	0.03477037869966947
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.000000000000036
survival_time_min	5.849999999999987

No reset possible

20693

3092

Claudio Ruch

Python template

aido2-AMOD-efficiency

step2-scoring

success

yes

aido2-AMOD-service_quality

2019-04-26 13:54:03+00:00

2019-04-26 13:54:18+00:00

0:00:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

efficiency

-457.40248913071866

other stats

fleet_size	-1000000000
service_quality	-130.56351228268008

No reset possible

20672

3085

Claudio Ruch

Java template

step1-simulation

success

yes

aido2-AMOD-service_quality

2019-04-26 12:35:17+00:00

2019-04-26 12:38:50+00:00

0:03:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

20671

3083

Claudio Ruch

Python template

step2-scoring

success

yes

2019-04-26 11:58:13+00:00

2019-04-26 11:58:54+00:00

0:00:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

service_quality

-32.95887861441097

other stats

efficiency	-66.14719445764378
fleet_size	-1000000000

No reset possible

20662

3074

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 10:03:03+00:00

2019-04-26 10:23:13+00:00

0:20:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6252569109420074
survival_time_median	10.90000000000002
deviation-center-line_median	0.5490335083832776
in-drivable-lane_median	3.7000000000000375

other stats

agent_compute-ego_max	0.16416551755822223
agent_compute-ego_mean	0.15960869843861478
agent_compute-ego_median	0.15872463611287807
agent_compute-ego_min	0.15415870587031047
deviation-center-line_max	0.6106327753200513
deviation-center-line_mean	0.532801950657037
deviation-center-line_min	0.4265911055808853
deviation-heading_max	1.6572896225144285
deviation-heading_mean	1.3742076894341104
deviation-heading_median	1.553845556243627
deviation-heading_min	0.9955244204567676
driven_any_max	1.3765220637299098
driven_any_mean	0.9543574334727816
driven_any_median	0.99324542562623
driven_any_min	0.5078301169618679
driven_lanedir_consec_max	0.8157436063955408
driven_lanedir_consec_mean	0.6484650479222424
driven_lanedir_consec_min	0.4987776919144906
driven_lanedir_max	0.8157436063955408
driven_lanedir_mean	0.6484650479222424
driven_lanedir_median	0.6252569109420074
driven_lanedir_min	0.4987776919144906
in-drivable-lane_max	5.9500000000000846
in-drivable-lane_mean	3.090000000000041
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.99324542562623, "sim_physics": 0.117739073727109, "survival_time": 10.90000000000002, "driven_lanedir": 0.6252569109420074, "sim_render-ego": 0.04656145222690127, "in-drivable-lane": 3.7000000000000375, "agent_compute-ego": 0.15872463611287807, "deviation-heading": 0.9955244204567676, "set_robot_commands": 0.06712147074008207, "deviation-center-line": 0.5490335083832776, "driven_lanedir_consec": 0.6252569109420074, "sim_compute_sim_state": 0.028330089849069574, "sim_compute_performance-ego": 0.050199165256745226, "sim_compute_robot_state-ego": 0.05293288908967184, "sim_compute_robot_state-npc0": 0.051296265847092376, "sim_compute_robot_state-npc1": 0.0502392687928786, "sim_compute_robot_state-npc2": 0.049921080606793046, "sim_compute_robot_state-npc3": 0.04962586700369458}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5192316224192188, "sim_physics": 0.11946235355148968, "survival_time": 5.849999999999987, "driven_lanedir": 0.4987776919144906, "sim_render-ego": 0.04757690633464064, "in-drivable-lane": 0, "agent_compute-ego": 0.1628146334591075, "deviation-heading": 1.6572896225144285, "set_robot_commands": 0.07405888728606395, "deviation-center-line": 0.4265911055808853, "driven_lanedir_consec": 0.4987776919144906, "sim_compute_sim_state": 0.030411451290815305, "sim_compute_performance-ego": 0.05169709319742317, "sim_compute_robot_state-ego": 0.055866565459813826, "sim_compute_robot_state-npc0": 0.05405929557278625, "sim_compute_robot_state-npc1": 0.05418999174721221, "sim_compute_robot_state-npc2": 0.051644628883427024, "sim_compute_robot_state-npc3": 0.05247470252534263}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3749579386266808, "sim_physics": 0.1182528018951416, "survival_time": 14.950000000000076, "driven_lanedir": 0.8157436063955408, "sim_render-ego": 0.043950936794281005, "in-drivable-lane": 5.800000000000082, "agent_compute-ego": 0.15415870587031047, "deviation-heading": 1.5874333342248423, "set_robot_commands": 0.06815903186798096, "deviation-center-line": 0.6106327753200513, "driven_lanedir_consec": 0.8157436063955408, "sim_compute_sim_state": 0.02852731307347615, "sim_compute_performance-ego": 0.048715524673461914, "sim_compute_robot_state-ego": 0.05175981601079305, "sim_compute_robot_state-npc0": 0.05143356561660767, "sim_compute_robot_state-npc1": 0.04997547547022502, "sim_compute_robot_state-npc2": 0.05054497162501017, "sim_compute_robot_state-npc3": 0.05055664936701457}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3765220637299098, "sim_physics": 0.12315772533416748, "survival_time": 14.950000000000076, "driven_lanedir": 0.8035095596068245, "sim_render-ego": 0.04580095767974854, "in-drivable-lane": 5.9500000000000846, "agent_compute-ego": 0.15817999919255574, "deviation-heading": 1.553845556243627, "set_robot_commands": 0.06951658725738526, "deviation-center-line": 0.5979815004734461, "driven_lanedir_consec": 0.8035095596068245, "sim_compute_sim_state": 0.029232189655303956, "sim_compute_performance-ego": 0.050888618628184, "sim_compute_robot_state-ego": 0.05221408049265543, "sim_compute_robot_state-npc0": 0.05249596834182739, "sim_compute_robot_state-npc1": 0.05133037408192952, "sim_compute_robot_state-npc2": 0.05092565933863322, "sim_compute_robot_state-npc3": 0.05101558446884155}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5078301169618679, "sim_physics": 0.11346138041952382, "survival_time": 5.749999999999988, "driven_lanedir": 0.4990374707523488, "sim_render-ego": 0.04846673426420792, "in-drivable-lane": 0, "agent_compute-ego": 0.16416551755822223, "deviation-heading": 1.0769455137308863, "set_robot_commands": 0.06891455857650093, "deviation-center-line": 0.479770863527525, "driven_lanedir_consec": 0.4990374707523488, "sim_compute_sim_state": 0.029023195349651833, "sim_compute_performance-ego": 0.052844302550606105, "sim_compute_robot_state-ego": 0.05629562502321989, "sim_compute_robot_state-npc0": 0.053414887967317, "sim_compute_robot_state-npc1": 0.052886401052060335, "sim_compute_robot_state-npc2": 0.05229481199513311, "sim_compute_robot_state-npc3": 0.05153655798538871}}
set_robot_commands_max	0.07405888728606395
set_robot_commands_mean	0.06955410714560263
set_robot_commands_median	0.06891455857650093
set_robot_commands_min	0.06712147074008207
sim_compute_performance-ego_max	0.052844302550606105
sim_compute_performance-ego_mean	0.05086894086128409
sim_compute_performance-ego_median	0.050888618628184
sim_compute_performance-ego_min	0.048715524673461914
sim_compute_robot_state-ego_max	0.05629562502321989
sim_compute_robot_state-ego_mean	0.05381379521523081
sim_compute_robot_state-ego_median	0.05293288908967184
sim_compute_robot_state-ego_min	0.05175981601079305
sim_compute_robot_state-npc0_max	0.05405929557278625
sim_compute_robot_state-npc0_mean	0.05253999666912614
sim_compute_robot_state-npc0_median	0.05249596834182739
sim_compute_robot_state-npc0_min	0.051296265847092376
sim_compute_robot_state-npc1_max	0.05418999174721221
sim_compute_robot_state-npc1_mean	0.05172430222886114
sim_compute_robot_state-npc1_median	0.05133037408192952
sim_compute_robot_state-npc1_min	0.04997547547022502
sim_compute_robot_state-npc2_max	0.05229481199513311
sim_compute_robot_state-npc2_mean	0.05106623048979931
sim_compute_robot_state-npc2_median	0.05092565933863322
sim_compute_robot_state-npc2_min	0.049921080606793046
sim_compute_robot_state-npc3_max	0.05247470252534263
sim_compute_robot_state-npc3_mean	0.05104187227005641
sim_compute_robot_state-npc3_median	0.05101558446884155
sim_compute_robot_state-npc3_min	0.04962586700369458
sim_compute_sim_state_max	0.030411451290815305
sim_compute_sim_state_mean	0.02910484784366336
sim_compute_sim_state_median	0.029023195349651833
sim_compute_sim_state_min	0.028330089849069574
sim_physics_max	0.12315772533416748
sim_physics_mean	0.11841466698548632
sim_physics_median	0.1182528018951416
sim_physics_min	0.11346138041952382
sim_render-ego_max	0.04846673426420792
sim_render-ego_mean	0.04647139745995587
sim_render-ego_median	0.04656145222690127
sim_render-ego_min	0.043950936794281005
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.480000000000029
survival_time_min	5.749999999999988

No reset possible

20641

2375

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

2019-04-25 15:17:31+00:00

2019-04-25 15:22:06+00:00

0:04:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6706320447655254
survival_time_median	3.649999999999995
deviation-center-line_median	0.1443022347216951
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.053791516535990944
agent_compute-ego_mean	0.047862553916382514
agent_compute-ego_median	0.04658874949893436
agent_compute-ego_min	0.04517364501953125
deviation-center-line_max	0.4004784761211184
deviation-center-line_mean	0.2180329391973995
deviation-center-line_min	0.1241222516023625
deviation-heading_max	1.0472953726467125
deviation-heading_mean	0.5587116998597059
deviation-heading_median	0.5584700619682197
deviation-heading_min	0.3001803644882976
driven_any_max	1.5796421483387642
driven_any_mean	0.8626819028624159
driven_any_median	0.9946421491379502
driven_any_min	0.2748323161055837
driven_lanedir_consec_max	1.1255773482598914
driven_lanedir_consec_mean	0.6744516539239503
driven_lanedir_consec_min	0.26694401727266204
driven_lanedir_max	1.1255773482598914
driven_lanedir_mean	0.6744516539239503
driven_lanedir_median	0.6706320447655254
driven_lanedir_min	0.26694401727266204
in-drivable-lane_max	1.499999999999995
in-drivable-lane_mean	0.5299999999999981
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9946421491379502, "sim_physics": 0.06695715368610539, "survival_time": 3.649999999999995, "driven_lanedir": 0.6706320447655254, "sim_render-ego": 0.04380951515615803, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.04517364501953125, "deviation-heading": 0.5584700619682197, "set_robot_commands": 0.06567560809932343, "deviation-center-line": 0.1443022347216951, "driven_lanedir_consec": 0.6706320447655254, "sim_compute_sim_state": 0.029485339987767884, "sim_compute_performance-ego": 0.05069690861114084, "sim_compute_robot_state-ego": 0.05263658092446523}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.009642148956158, "sim_physics": 0.07627969174771695, "survival_time": 3.699999999999995, "driven_lanedir": 0.8759181599115546, "sim_render-ego": 0.04974622662002976, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.053791516535990944, "deviation-heading": 1.0472953726467125, "set_robot_commands": 0.08014201151358115, "deviation-center-line": 0.29628367710760867, "driven_lanedir_consec": 0.8759181599115546, "sim_compute_sim_state": 0.03281286278286496, "sim_compute_performance-ego": 0.05721444374806172, "sim_compute_robot_state-ego": 0.058847224390184555}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2748323161055837, "sim_physics": 0.06640679359436036, "survival_time": 1.2500000000000004, "driven_lanedir": 0.26694401727266204, "sim_render-ego": 0.04535813331604003, "in-drivable-lane": 0, "agent_compute-ego": 0.046489286422729495, "deviation-heading": 0.3001803644882976, "set_robot_commands": 0.06729275703430176, "deviation-center-line": 0.1241222516023625, "driven_lanedir_consec": 0.26694401727266204, "sim_compute_sim_state": 0.02853656768798828, "sim_compute_performance-ego": 0.048007965087890625, "sim_compute_robot_state-ego": 0.05130533218383789}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4546507517736229, "sim_physics": 0.07440431697948559, "survival_time": 1.850000000000001, "driven_lanedir": 0.43318669941011834, "sim_render-ego": 0.0435578694214692, "in-drivable-lane": 0, "agent_compute-ego": 0.04658874949893436, "deviation-heading": 0.5707543029776994, "set_robot_commands": 0.06594672718563595, "deviation-center-line": 0.1249780564342128, "driven_lanedir_consec": 0.43318669941011834, "sim_compute_sim_state": 0.030586100913382864, "sim_compute_performance-ego": 0.04879616402290963, "sim_compute_robot_state-ego": 0.051141255610697975}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5796421483387642, "sim_physics": 0.0721252007143838, "survival_time": 5.599999999999988, "driven_lanedir": 1.1255773482598914, "sim_render-ego": 0.04450752692563193, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.04726957210472652, "deviation-heading": 0.31685839721760034, "set_robot_commands": 0.06964521322931562, "deviation-center-line": 0.4004784761211184, "driven_lanedir_consec": 1.1255773482598914, "sim_compute_sim_state": 0.029641164200646535, "sim_compute_performance-ego": 0.04842746044908251, "sim_compute_robot_state-ego": 0.051781258412769864}}
set_robot_commands_max	0.08014201151358115
set_robot_commands_mean	0.06974046341243158
set_robot_commands_median	0.06729275703430176
set_robot_commands_min	0.06567560809932343
sim_compute_performance-ego_max	0.05721444374806172
sim_compute_performance-ego_mean	0.050628588383817064
sim_compute_performance-ego_median	0.04879616402290963
sim_compute_performance-ego_min	0.048007965087890625
sim_compute_robot_state-ego_max	0.058847224390184555
sim_compute_robot_state-ego_mean	0.053142330304391104
sim_compute_robot_state-ego_median	0.051781258412769864
sim_compute_robot_state-ego_min	0.051141255610697975
sim_compute_sim_state_max	0.03281286278286496
sim_compute_sim_state_mean	0.030212407114530104
sim_compute_sim_state_median	0.029641164200646535
sim_compute_sim_state_min	0.02853656768798828
sim_physics_max	0.07627969174771695
sim_physics_mean	0.07123463134441041
sim_physics_median	0.0721252007143838
sim_physics_min	0.06640679359436036
sim_render-ego_max	0.04974622662002976
sim_render-ego_mean	0.045395854287865786
sim_render-ego_median	0.04450752692563193
sim_render-ego_min	0.0435578694214692
simulation-passed	1
survival_time_max	5.599999999999988
survival_time_mean	3.209999999999996
survival_time_min	1.2500000000000004

No reset possible

20619

2370

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 15:00:13+00:00

2019-04-25 15:11:45+00:00

0:11:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.658141340093886
survival_time_median	6.999999999999983
deviation-center-line_median	0.3805179887067449
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.16093652875799885
agent_compute-ego_mean	0.14559097435051585
agent_compute-ego_median	0.14386348657205072
agent_compute-ego_min	0.13358676433563232
deviation-center-line_max	0.8219069617270801
deviation-center-line_mean	0.4622890220224802
deviation-center-line_min	0.240946508088056
deviation-heading_max	1.819384597985526
deviation-heading_mean	0.9470500519861752
deviation-heading_median	0.8064348941516836
deviation-heading_min	0.5022393903257442
driven_any_max	1.5790906665051212
driven_any_mean	0.90897363561738
driven_any_median	0.9970530395825568
driven_any_min	0.2870933095253068
driven_lanedir_consec_max	1.1522212258289768
driven_lanedir_consec_mean	0.7286312661816596
driven_lanedir_consec_min	0.2804952221609298
driven_lanedir_max	1.1522212258289768
driven_lanedir_mean	0.7286312661816596
driven_lanedir_median	0.658141340093886
driven_lanedir_min	0.2804952221609298
in-drivable-lane_max	2.80000000000004
in-drivable-lane_mean	1.0400000000000065
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9970530395825568, "sim_physics": 0.09886787618909564, "survival_time": 6.999999999999983, "driven_lanedir": 0.658141340093886, "sim_render-ego": 0.05667736870901925, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.14301748616354806, "deviation-heading": 0.8064348941516836, "set_robot_commands": 0.08794472558157784, "deviation-center-line": 0.3310166859136158, "driven_lanedir_consec": 0.658141340093886, "sim_compute_sim_state": 0.035494193008967806, "sim_compute_performance-ego": 0.06455543552126203, "sim_compute_robot_state-ego": 0.0669594168663025}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.018001036910281, "sim_physics": 0.11200924154738304, "survival_time": 7.099999999999983, "driven_lanedir": 0.9032065052271656, "sim_render-ego": 0.05793450248073524, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.14386348657205072, "deviation-heading": 1.819384597985526, "set_robot_commands": 0.09318656988546882, "deviation-center-line": 0.5370569656769042, "driven_lanedir_consec": 0.9032065052271656, "sim_compute_sim_state": 0.03840031086559027, "sim_compute_performance-ego": 0.0663984476680487, "sim_compute_robot_state-ego": 0.07450874590537918}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2870933095253068, "sim_physics": 0.0916464898897254, "survival_time": 2.3, "driven_lanedir": 0.2804952221609298, "sim_render-ego": 0.05329076103542162, "in-drivable-lane": 0, "agent_compute-ego": 0.13358676433563232, "deviation-heading": 0.5022393903257442, "set_robot_commands": 0.08706033229827881, "deviation-center-line": 0.240946508088056, "driven_lanedir_consec": 0.2804952221609298, "sim_compute_sim_state": 0.034504916356957474, "sim_compute_performance-ego": 0.05848002952078114, "sim_compute_robot_state-ego": 0.062092496001202126}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6636301255636338, "sim_physics": 0.1053196580786454, "survival_time": 4.749999999999991, "driven_lanedir": 0.6490920375973404, "sim_render-ego": 0.06281800772014418, "in-drivable-lane": 0, "agent_compute-ego": 0.16093652875799885, "deviation-heading": 0.9802944231598162, "set_robot_commands": 0.10154539158469753, "deviation-center-line": 0.3805179887067449, "driven_lanedir_consec": 0.6490920375973404, "sim_compute_sim_state": 0.03932692879124692, "sim_compute_performance-ego": 0.0711621409968326, "sim_compute_robot_state-ego": 0.07581827013116134}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5790906665051212, "sim_physics": 0.11546019035550306, "survival_time": 10.85000000000002, "driven_lanedir": 1.1522212258289768, "sim_render-ego": 0.05865050241145121, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.1465506059233494, "deviation-heading": 0.626896954308107, "set_robot_commands": 0.09418883411565684, "deviation-center-line": 0.8219069617270801, "driven_lanedir_consec": 1.1522212258289768, "sim_compute_sim_state": 0.03775617603882117, "sim_compute_performance-ego": 0.06625575294143043, "sim_compute_robot_state-ego": 0.07132939589188396}}
set_robot_commands_max	0.10154539158469753
set_robot_commands_mean	0.09278517069313597
set_robot_commands_median	0.09318656988546882
set_robot_commands_min	0.08706033229827881
sim_compute_performance-ego_max	0.0711621409968326
sim_compute_performance-ego_mean	0.06537036132967097
sim_compute_performance-ego_median	0.06625575294143043
sim_compute_performance-ego_min	0.05848002952078114
sim_compute_robot_state-ego_max	0.07581827013116134
sim_compute_robot_state-ego_mean	0.07014166495918582
sim_compute_robot_state-ego_median	0.07132939589188396
sim_compute_robot_state-ego_min	0.062092496001202126
sim_compute_sim_state_max	0.03932692879124692
sim_compute_sim_state_mean	0.037096505012316726
sim_compute_sim_state_median	0.03775617603882117
sim_compute_sim_state_min	0.034504916356957474
sim_physics_max	0.11546019035550306
sim_physics_mean	0.10466069121207051
sim_physics_median	0.1053196580786454
sim_physics_min	0.0916464898897254
sim_render-ego_max	0.06281800772014418
sim_render-ego_mean	0.0578742284713543
sim_render-ego_median	0.05793450248073524
sim_render-ego_min	0.05329076103542162
simulation-passed	1
survival_time_max	10.85000000000002
survival_time_mean	6.399999999999995
survival_time_min	2.3

No reset possible

20607

2384

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-25 14:55:25+00:00

2019-04-25 15:00:06+00:00

0:04:41

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20607-757590', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20607-757590', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20607-757590', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20597

2391

Liam Paull 🇨🇦

random_agent

step1-simulation

success

2019-04-25 14:50:00+00:00

2019-04-25 14:55:09+00:00

0:05:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.13566276660332313
agent_compute-ego_mean	0.12170280059417048
agent_compute-ego_median	0.1263054226929287
agent_compute-ego_min	0.09035643577575685
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.10064614044045504, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.05800535543909613, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.1263054226929287, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.08703452236247512, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03624801815680738, "sim_compute_performance-ego": 0.06778528105537847, "sim_compute_robot_state-ego": 0.07548036665286657}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.09361174014898446, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.06038883099189171, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.13566276660332313, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.09553286203971276, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.038200777310591474, "sim_compute_performance-ego": 0.06964621635583731, "sim_compute_robot_state-ego": 0.07664856085410485}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.08311890231238471, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.05759069654676649, "in-drivable-lane": 0, "agent_compute-ego": 0.13198738627963597, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.09267165925767688, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.040486163563198514, "sim_compute_performance-ego": 0.06616237428453234, "sim_compute_robot_state-ego": 0.07292124960157606}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.07104426383972168, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.041010169982910155, "in-drivable-lane": 0, "agent_compute-ego": 0.09035643577575685, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.06227245330810547, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.02618914604187012, "sim_compute_performance-ego": 0.044383697509765625, "sim_compute_robot_state-ego": 0.04600574493408203}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.09662523636451134, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.05386628248752691, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.12420199161920792, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.08544733891120324, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.03514687831585224, "sim_compute_performance-ego": 0.05868733540559427, "sim_compute_robot_state-ego": 0.06351689191964957}}
set_robot_commands_max	0.09553286203971276
set_robot_commands_mean	0.08459176717583469
set_robot_commands_median	0.08703452236247512
set_robot_commands_min	0.06227245330810547
sim_compute_performance-ego_max	0.06964621635583731
sim_compute_performance-ego_mean	0.0613329809222216
sim_compute_performance-ego_median	0.06616237428453234
sim_compute_performance-ego_min	0.044383697509765625
sim_compute_robot_state-ego_max	0.07664856085410485
sim_compute_robot_state-ego_mean	0.06691456279245582
sim_compute_robot_state-ego_median	0.07292124960157606
sim_compute_robot_state-ego_min	0.04600574493408203
sim_compute_sim_state_max	0.040486163563198514
sim_compute_sim_state_mean	0.03525419667766394
sim_compute_sim_state_median	0.03624801815680738
sim_compute_sim_state_min	0.02618914604187012
sim_physics_max	0.10064614044045504
sim_physics_mean	0.08900925662121144
sim_physics_median	0.09361174014898446
sim_physics_min	0.07104426383972168
sim_render-ego_max	0.06038883099189171
sim_render-ego_mean	0.05417226708963828
sim_render-ego_median	0.05759069654676649
sim_render-ego_min	0.041010169982910155
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20595

2401

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 14:48:11+00:00

2019-04-25 14:49:20+00:00

0:01:09

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20553

2451

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:10:19+00:00

2019-04-25 14:47:57+00:00

0:37:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3401138062222346
survival_time_median	14.950000000000076
deviation-center-line_median	1.0020906406379184
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.16332919279734293
agent_compute-ego_mean	0.16154538631439208
agent_compute-ego_median	0.16226433118184408
agent_compute-ego_min	0.15904266436894737
deviation-center-line_max	1.5200592903810726
deviation-center-line_mean	0.9234183234449912
deviation-center-line_min	0.28265732013386635
deviation-heading_max	8.488415384770875
deviation-heading_mean	7.083018992579007
deviation-heading_median	7.089126128887597
deviation-heading_min	5.694184625828925
driven_any_max	4.378320939674843
driven_any_mean	4.378320939674839
driven_any_median	4.378320939674839
driven_any_min	4.378320939674832
driven_lanedir_consec_max	-1.2731239579032123
driven_lanedir_consec_mean	-1.331671690718409
driven_lanedir_consec_min	-1.3673592918445536
driven_lanedir_max	-1.366645308459499
driven_lanedir_mean	-2.07783178706321
driven_lanedir_median	-2.2611460594308452
driven_lanedir_min	-2.711272030505655
in-drivable-lane_max	7.400000000000039
in-drivable-lane_mean	4.630000000000026
in-drivable-lane_min	2.150000000000011
per-episodes	details {"udem1-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.1953042960166931, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272030505655, "sim_render-ego": 0.06107684850692749, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16226433118184408, "deviation-heading": 8.371542541054898, "set_robot_commands": 0.09057140429814656, "deviation-center-line": 1.5194332899756515, "driven_lanedir_consec": -1.3111160891625455, "sim_compute_sim_state": 0.037815741697947186, "sim_compute_performance-ego": 0.06676226933797201, "sim_compute_robot_state-ego": 0.06868514855702718, "sim_compute_robot_state-npc0": 0.06540701150894165, "sim_compute_robot_state-npc1": 0.06587793906529744, "sim_compute_robot_state-npc2": 0.06587167819341024, "sim_compute_robot_state-npc3": 0.06642692724863689}, "udem1-1-0": {"driven_any": 4.378320939674842, "sim_physics": 0.20796398401260377, "survival_time": 14.950000000000076, "driven_lanedir": -2.682736245075499, "sim_render-ego": 0.060955193837483726, "in-drivable-lane": 2.2000000000000113, "agent_compute-ego": 0.16332919279734293, "deviation-heading": 8.488415384770875, "set_robot_commands": 0.09121515353520712, "deviation-center-line": 1.5200592903810726, "driven_lanedir_consec": -1.2731239579032123, "sim_compute_sim_state": 0.03795449813206991, "sim_compute_performance-ego": 0.0660978897412618, "sim_compute_robot_state-ego": 0.06918162743250529, "sim_compute_robot_state-npc0": 0.06606880346934, "sim_compute_robot_state-npc1": 0.06728325843811035, "sim_compute_robot_state-npc2": 0.06594645579655965, "sim_compute_robot_state-npc3": 0.06734838088353474}, "udem1-2-0": {"driven_any": 4.378320939674832, "sim_physics": 0.1894840915997823, "survival_time": 14.950000000000076, "driven_lanedir": -1.366645308459499, "sim_render-ego": 0.06135841210683187, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.16257554054260254, "deviation-heading": 5.771826282352732, "set_robot_commands": 0.09190938393274944, "deviation-center-line": 0.2928510760964476, "driven_lanedir_consec": -1.366645308459499, "sim_compute_sim_state": 0.04068568547566732, "sim_compute_performance-ego": 0.06690142790476482, "sim_compute_robot_state-ego": 0.07030516465504964, "sim_compute_robot_state-npc0": 0.06635961373647054, "sim_compute_robot_state-npc1": 0.06726239760716757, "sim_compute_robot_state-npc2": 0.06815449873606363, "sim_compute_robot_state-npc3": 0.06859435637791951}, "udem1-3-0": {"driven_any": 4.378320939674839, "sim_physics": 0.19944446245829264, "survival_time": 14.950000000000076, "driven_lanedir": -1.3673592918445536, "sim_render-ego": 0.06004930337270101, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.15904266436894737, "deviation-heading": 5.694184625828925, "set_robot_commands": 0.09189359982808432, "deviation-center-line": 0.28265732013386635, "driven_lanedir_consec": -1.3673592918445536, "sim_compute_sim_state": 0.03812280972798665, "sim_compute_performance-ego": 0.06684209108352661, "sim_compute_robot_state-ego": 0.07025696436564127, "sim_compute_robot_state-npc0": 0.0672758412361145, "sim_compute_robot_state-npc1": 0.066143426100413, "sim_compute_robot_state-npc2": 0.06565173784891765, "sim_compute_robot_state-npc3": 0.06572386741638184}, "udem1-4-0": {"driven_any": 4.378320939674835, "sim_physics": 0.20053547143936157, "survival_time": 14.950000000000076, "driven_lanedir": -2.2611460594308452, "sim_render-ego": 0.05961623112360637, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.16051520268122357, "deviation-heading": 7.089126128887597, "set_robot_commands": 0.09160345395406087, "deviation-center-line": 1.0020906406379184, "driven_lanedir_consec": -1.3401138062222346, "sim_compute_sim_state": 0.037382040023803714, "sim_compute_performance-ego": 0.06553608099619547, "sim_compute_robot_state-ego": 0.06881665865580242, "sim_compute_robot_state-npc0": 0.06712471882502238, "sim_compute_robot_state-npc1": 0.0665452774365743, "sim_compute_robot_state-npc2": 0.06711453119913736, "sim_compute_robot_state-npc3": 0.06685847997665405}}
set_robot_commands_max	0.09190938393274944
set_robot_commands_mean	0.09143859910964966
set_robot_commands_median	0.09160345395406087
set_robot_commands_min	0.09057140429814656
sim_compute_performance-ego_max	0.06690142790476482
sim_compute_performance-ego_mean	0.06642795181274415
sim_compute_performance-ego_median	0.06676226933797201
sim_compute_performance-ego_min	0.06553608099619547
sim_compute_robot_state-ego_max	0.07030516465504964
sim_compute_robot_state-ego_mean	0.06944911273320516
sim_compute_robot_state-ego_median	0.06918162743250529
sim_compute_robot_state-ego_min	0.06868514855702718
sim_compute_robot_state-npc0_max	0.0672758412361145
sim_compute_robot_state-npc0_mean	0.06644719775517782
sim_compute_robot_state-npc0_median	0.06635961373647054
sim_compute_robot_state-npc0_min	0.06540701150894165
sim_compute_robot_state-npc1_max	0.06728325843811035
sim_compute_robot_state-npc1_mean	0.06662245972951253
sim_compute_robot_state-npc1_median	0.0665452774365743
sim_compute_robot_state-npc1_min	0.06587793906529744
sim_compute_robot_state-npc2_max	0.06815449873606363
sim_compute_robot_state-npc2_mean	0.0665477803548177
sim_compute_robot_state-npc2_median	0.06594645579655965
sim_compute_robot_state-npc2_min	0.06565173784891765
sim_compute_robot_state-npc3_max	0.06859435637791951
sim_compute_robot_state-npc3_mean	0.06699040238062541
sim_compute_robot_state-npc3_median	0.06685847997665405
sim_compute_robot_state-npc3_min	0.06572386741638184
sim_compute_sim_state_max	0.04068568547566732
sim_compute_sim_state_mean	0.038392155011494955
sim_compute_sim_state_median	0.03795449813206991
sim_compute_sim_state_min	0.037382040023803714
sim_physics_max	0.20796398401260377
sim_physics_mean	0.19854646110534668
sim_physics_median	0.19944446245829264
sim_physics_min	0.1894840915997823
sim_render-ego_max	0.06135841210683187
sim_render-ego_mean	0.060611197789510095
sim_render-ego_median	0.060955193837483726
sim_render-ego_min	0.05961623112360637
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20549

2459

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:09:22+00:00

2019-04-25 14:09:59+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20547

2460

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:08:30+00:00

2019-04-25 14:09:10+00:00

0:00:40

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20535

2492

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 14:02:04+00:00

2019-04-25 14:08:03+00:00

0:05:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1110897592186153
survival_time_median	1.800000000000001
deviation-center-line_median	0.0455344313918222
in-drivable-lane_median	0.5000000000000004

other stats

agent_compute-ego_max	0.17218023254757836
agent_compute-ego_mean	0.1597365701879774
agent_compute-ego_median	0.16396045207977294
agent_compute-ego_min	0.12982883056004843
deviation-center-line_max	0.12926999586652826
deviation-center-line_mean	0.06982255026998514
deviation-center-line_min	0.04126530252285899
deviation-heading_max	1.7939770330461546
deviation-heading_mean	0.9218308437668614
deviation-heading_median	0.7365879019897029
deviation-heading_min	0.6631452791352754
driven_any_max	0.6596859130483886
driven_any_mean	0.2762339168638512
driven_any_median	0.2143862600260754
driven_any_min	0.09711300124116042
driven_lanedir_consec_max	0.19396067106067696
driven_lanedir_consec_mean	0.10555653656726804
driven_lanedir_consec_min	0.04700451415223083
driven_lanedir_max	0.19396067106067696
driven_lanedir_mean	0.10555653656726804
driven_lanedir_median	0.1110897592186153
driven_lanedir_min	0.04700451415223083
in-drivable-lane_max	2.3999999999999955
in-drivable-lane_mean	0.7999999999999994
in-drivable-lane_min	0.05000000000000005
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6596859130483886, "sim_physics": 0.10860995292663574, "survival_time": 4.99999999999999, "driven_lanedir": 0.19396067106067696, "sim_render-ego": 0.06134503841400146, "in-drivable-lane": 2.3999999999999955, "agent_compute-ego": 0.16396045207977294, "deviation-heading": 1.7939770330461546, "set_robot_commands": 0.09716305732727051, "deviation-center-line": 0.12926999586652826, "driven_lanedir_consec": 0.19396067106067696, "sim_compute_sim_state": 0.0387553858757019, "sim_compute_performance-ego": 0.06766629695892334, "sim_compute_robot_state-ego": 0.07401588916778565}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2143862600260754, "sim_physics": 0.09646658102671306, "survival_time": 1.800000000000001, "driven_lanedir": 0.11989504681105569, "sim_render-ego": 0.05736133787367079, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16935718059539795, "deviation-heading": 0.7365879019897029, "set_robot_commands": 0.0897397067811754, "deviation-center-line": 0.0455344313918222, "driven_lanedir_consec": 0.11989504681105569, "sim_compute_sim_state": 0.038187881310780845, "sim_compute_performance-ego": 0.0667538775338067, "sim_compute_robot_state-ego": 0.06763554943932427}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09711300124116042, "sim_physics": 0.0869147777557373, "survival_time": 1.0500000000000005, "driven_lanedir": 0.055832691593761474, "sim_render-ego": 0.05971238726661319, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17218023254757836, "deviation-heading": 0.6659617415935564, "set_robot_commands": 0.09396432694934664, "deviation-center-line": 0.08875411030379138, "driven_lanedir_consec": 0.055832691593761474, "sim_compute_sim_state": 0.03731723058791388, "sim_compute_performance-ego": 0.06520687966119676, "sim_compute_robot_state-ego": 0.07553656895955403}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18195359413829237, "sim_physics": 0.08895047008991241, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04700451415223083, "sim_render-ego": 0.06193837523460388, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.16335615515708923, "deviation-heading": 0.7494822630696174, "set_robot_commands": 0.08615969121456146, "deviation-center-line": 0.04126530252285899, "driven_lanedir_consec": 0.04700451415223083, "sim_compute_sim_state": 0.03775419294834137, "sim_compute_performance-ego": 0.05884656310081482, "sim_compute_robot_state-ego": 0.06916221976280212}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22803081586533935, "sim_physics": 0.08263931671778361, "survival_time": 1.800000000000001, "driven_lanedir": 0.1110897592186153, "sim_render-ego": 0.04763842291302151, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.12982883056004843, "deviation-heading": 0.6631452791352754, "set_robot_commands": 0.07427787118487889, "deviation-center-line": 0.044288911264924846, "driven_lanedir_consec": 0.1110897592186153, "sim_compute_sim_state": 0.03124729130003187, "sim_compute_performance-ego": 0.062292906973097056, "sim_compute_robot_state-ego": 0.05558037095599704}}
set_robot_commands_max	0.09716305732727051
set_robot_commands_mean	0.08826093069144658
set_robot_commands_median	0.0897397067811754
set_robot_commands_min	0.07427787118487889
sim_compute_performance-ego_max	0.06766629695892334
sim_compute_performance-ego_mean	0.06415330484556774
sim_compute_performance-ego_median	0.06520687966119676
sim_compute_performance-ego_min	0.05884656310081482
sim_compute_robot_state-ego_max	0.07553656895955403
sim_compute_robot_state-ego_mean	0.06838611965709263
sim_compute_robot_state-ego_median	0.06916221976280212
sim_compute_robot_state-ego_min	0.05558037095599704
sim_compute_sim_state_max	0.0387553858757019
sim_compute_sim_state_mean	0.03665239640455397
sim_compute_sim_state_median	0.03775419294834137
sim_compute_sim_state_min	0.03124729130003187
sim_physics_max	0.10860995292663574
sim_physics_mean	0.09271621970335645
sim_physics_median	0.08895047008991241
sim_physics_min	0.08263931671778361
sim_render-ego_max	0.06193837523460388
sim_render-ego_mean	0.05759911234038216
sim_render-ego_median	0.05971238726661319
sim_render-ego_min	0.04763842291302151
simulation-passed	1
survival_time_max	4.99999999999999
survival_time_mean	2.2499999999999987
survival_time_min	1.0500000000000005

No reset possible

20526

2520

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 14:01:16+00:00

2019-04-25 14:01:57+00:00

0:00:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20509

2509

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

host-error

2019-04-25 13:59:36+00:00

2019-04-25 14:00:48+00:00

0:01:12

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20509-326530', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20509-326530', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20509-326530', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20498

2528

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-25 13:56:33+00:00

2019-04-25 13:59:29+00:00

0:02:56

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20486

2547

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:49:47+00:00

2019-04-25 13:56:26+00:00

0:06:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7512916548554684
survival_time_median	3.7999999999999945
deviation-center-line_median	0.18412495978986793
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.06867643241043929
agent_compute-ego_mean	0.06409751163585597
agent_compute-ego_median	0.06768206582553145
agent_compute-ego_min	0.05097171821092304
deviation-center-line_max	0.2407793328387492
deviation-center-line_mean	0.18524304998761165
deviation-center-line_min	0.10543526712795737
deviation-heading_max	1.078034640218307
deviation-heading_mean	0.5372342619527618
deviation-heading_median	0.3838282375787499
deviation-heading_min	0.27824896253672804
driven_any_max	1.320019378772244
driven_any_mean	0.9597161700643624
driven_any_median	1.0035384623320458
driven_any_min	0.22182656237034495
driven_lanedir_consec_max	0.9856760680639272
driven_lanedir_consec_mean	0.639512700274553
driven_lanedir_consec_min	0.21092633501229985
driven_lanedir_max	0.9856760680639272
driven_lanedir_mean	0.639512700274553
driven_lanedir_median	0.7512916548554684
driven_lanedir_min	0.21092633501229985
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.9599999999999967
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.06612550898602135, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.0449380309958207, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.05097171821092304, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.06842329313880519, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.029304937312477512, "sim_compute_performance-ego": 0.04896145117910285, "sim_compute_robot_state-ego": 0.05123135604356464}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.0878602663675944, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.056914025458736694, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.06768206582553145, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.08599381170411041, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.03564902319424394, "sim_compute_performance-ego": 0.06358614520750185, "sim_compute_robot_state-ego": 0.1002043364704519}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.07933774861422452, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.05993199348449707, "in-drivable-lane": 0, "agent_compute-ego": 0.06450322541323575, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.08557088808579878, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.03593362461436878, "sim_compute_performance-ego": 0.06778848171234131, "sim_compute_robot_state-ego": 0.06799859350377863}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.0994291331741836, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.05996219142452701, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06867643241043929, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.0944749837393289, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.03783811055696928, "sim_compute_performance-ego": 0.06785124736827808, "sim_compute_robot_state-ego": 0.07535841962793371}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.10201311111450195, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.0616978577205113, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.06865411631915035, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.09383361923451326, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.038601870439490496, "sim_compute_performance-ego": 0.06667008448620232, "sim_compute_robot_state-ego": 0.07470099780024314}}
set_robot_commands_max	0.0944749837393289
set_robot_commands_mean	0.08565931918051131
set_robot_commands_median	0.08599381170411041
set_robot_commands_min	0.06842329313880519
sim_compute_performance-ego_max	0.06785124736827808
sim_compute_performance-ego_mean	0.06297148199068528
sim_compute_performance-ego_median	0.06667008448620232
sim_compute_performance-ego_min	0.04896145117910285
sim_compute_robot_state-ego_max	0.1002043364704519
sim_compute_robot_state-ego_mean	0.07389874068919441
sim_compute_robot_state-ego_median	0.07470099780024314
sim_compute_robot_state-ego_min	0.05123135604356464
sim_compute_sim_state_max	0.038601870439490496
sim_compute_sim_state_mean	0.035465513223510006
sim_compute_sim_state_median	0.03593362461436878
sim_compute_sim_state_min	0.029304937312477512
sim_physics_max	0.10201311111450195
sim_physics_mean	0.08695315365130515
sim_physics_median	0.0878602663675944
sim_physics_min	0.06612550898602135
sim_render-ego_max	0.0616978577205113
sim_render-ego_mean	0.056688819816818545
sim_render-ego_median	0.05993199348449707
sim_render-ego_min	0.0449380309958207
simulation-passed	1
survival_time_max	4.899999999999991
survival_time_mean	3.5599999999999943
survival_time_min	1.1000000000000003

No reset possible

20476

2565

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:41:34+00:00

2019-04-25 13:49:02+00:00

0:07:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3868568300517894
survival_time_median	2.5999999999999988
deviation-center-line_median	0.15225004755568958
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.0751072918927228
agent_compute-ego_mean	0.0645232570032377
agent_compute-ego_median	0.0707619098516611
agent_compute-ego_min	0.05210318377143458
deviation-center-line_max	0.2226582868882649
deviation-center-line_mean	0.14955415747516515
deviation-center-line_min	0.07892312124490847
deviation-heading_max	0.6459861795320978
deviation-heading_mean	0.4218478130160275
deviation-heading_median	0.4137732464571467
deviation-heading_min	0.27336376225758874
driven_any_max	1.055875722117673
driven_any_mean	0.6977105716937329
driven_any_median	0.7159098475930167
driven_any_min	0.3467630612192843
driven_lanedir_consec_max	0.7088980300052077
driven_lanedir_consec_mean	0.48067012473886733
driven_lanedir_consec_min	0.32585193632314957
driven_lanedir_max	0.7088980300052077
driven_lanedir_mean	0.48067012473886733
driven_lanedir_median	0.3868568300517894
driven_lanedir_min	0.32585193632314957
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.6799999999999977
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.0994134921776621, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.04528998073778654, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.05210318377143458, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.06888595693989803, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.02850223528711419, "sim_compute_performance-ego": 0.04964644344229447, "sim_compute_robot_state-ego": 0.05192237778713829, "sim_compute_robot_state-npc0": 0.053247658829939995, "sim_compute_robot_state-npc1": 0.053162606138932075, "sim_compute_robot_state-npc2": 0.052981477034719365, "sim_compute_robot_state-npc3": 0.05090545666845221}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3784135552892568, "sim_physics": 0.10308711230754852, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3420775634537585, "sim_render-ego": 0.042599014937877655, "in-drivable-lane": 0, "agent_compute-ego": 0.053444840013980865, "deviation-heading": 0.6459861795320978, "set_robot_commands": 0.06501076370477676, "deviation-center-line": 0.10981437189709492, "driven_lanedir_consec": 0.3420775634537585, "sim_compute_sim_state": 0.026426009833812714, "sim_compute_performance-ego": 0.04825536161661148, "sim_compute_robot_state-ego": 0.05153493583202362, "sim_compute_robot_state-npc0": 0.04839249700307846, "sim_compute_robot_state-npc1": 0.046871118247509, "sim_compute_robot_state-npc2": 0.04802595824003219, "sim_compute_robot_state-npc3": 0.04704565554857254}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7159098475930167, "sim_physics": 0.16913972451136663, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7088980300052077, "sim_render-ego": 0.061723800805898815, "in-drivable-lane": 0, "agent_compute-ego": 0.0707619098516611, "deviation-heading": 0.27336376225758874, "set_robot_commands": 0.09667615707104024, "deviation-center-line": 0.2226582868882649, "driven_lanedir_consec": 0.7088980300052077, "sim_compute_sim_state": 0.037256676417130694, "sim_compute_performance-ego": 0.06952546651546772, "sim_compute_robot_state-ego": 0.07326646493031429, "sim_compute_robot_state-npc0": 0.06723611171428974, "sim_compute_robot_state-npc1": 0.06997437202013455, "sim_compute_robot_state-npc2": 0.06604752173790565, "sim_compute_robot_state-npc3": 0.07136557193902823}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.055875722117673, "sim_physics": 0.14053941995669633, "survival_time": 3.899999999999994, "driven_lanedir": 0.6396662638604318, "sim_render-ego": 0.06147428353627523, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07119905948638916, "deviation-heading": 0.4978669142965758, "set_robot_commands": 0.0968070244177794, "deviation-center-line": 0.15225004755568958, "driven_lanedir_consec": 0.6396662638604318, "sim_compute_sim_state": 0.038108052351535894, "sim_compute_performance-ego": 0.06795551226689266, "sim_compute_robot_state-ego": 0.07234642750177628, "sim_compute_robot_state-npc0": 0.06768843760857216, "sim_compute_robot_state-npc1": 0.06550419636261769, "sim_compute_robot_state-npc2": 0.06713316073784462, "sim_compute_robot_state-npc3": 0.06827394778911884}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3467630612192843, "sim_physics": 0.13619668395430953, "survival_time": 1.3500000000000003, "driven_lanedir": 0.32585193632314957, "sim_render-ego": 0.06426821814643012, "in-drivable-lane": 0, "agent_compute-ego": 0.0751072918927228, "deviation-heading": 0.4137732464571467, "set_robot_commands": 0.10037353303697374, "deviation-center-line": 0.07892312124490847, "driven_lanedir_consec": 0.32585193632314957, "sim_compute_sim_state": 0.03795392424971969, "sim_compute_performance-ego": 0.07541922286704734, "sim_compute_robot_state-ego": 0.08158058590359157, "sim_compute_robot_state-npc0": 0.07108147939046223, "sim_compute_robot_state-npc1": 0.07061472645512333, "sim_compute_robot_state-npc2": 0.0700132758529098, "sim_compute_robot_state-npc3": 0.06864468256632487}}
set_robot_commands_max	0.10037353303697374
set_robot_commands_mean	0.08555068703409363
set_robot_commands_median	0.09667615707104024
set_robot_commands_min	0.06501076370477676
sim_compute_performance-ego_max	0.07541922286704734
sim_compute_performance-ego_mean	0.06216040134166273
sim_compute_performance-ego_median	0.06795551226689266
sim_compute_performance-ego_min	0.04825536161661148
sim_compute_robot_state-ego_max	0.08158058590359157
sim_compute_robot_state-ego_mean	0.06613015839096881
sim_compute_robot_state-ego_median	0.07234642750177628
sim_compute_robot_state-ego_min	0.05153493583202362
sim_compute_robot_state-npc0_max	0.07108147939046223
sim_compute_robot_state-npc0_mean	0.06152923690926851
sim_compute_robot_state-npc0_median	0.06723611171428974
sim_compute_robot_state-npc0_min	0.04839249700307846
sim_compute_robot_state-npc1_max	0.07061472645512333
sim_compute_robot_state-npc1_mean	0.06122540384486334
sim_compute_robot_state-npc1_median	0.06550419636261769
sim_compute_robot_state-npc1_min	0.046871118247509
sim_compute_robot_state-npc2_max	0.0700132758529098
sim_compute_robot_state-npc2_mean	0.06084027872068233
sim_compute_robot_state-npc2_median	0.06604752173790565
sim_compute_robot_state-npc2_min	0.04802595824003219
sim_compute_robot_state-npc3_max	0.07136557193902823
sim_compute_robot_state-npc3_mean	0.061247062902299344
sim_compute_robot_state-npc3_median	0.06827394778911884
sim_compute_robot_state-npc3_min	0.04704565554857254
sim_compute_sim_state_max	0.038108052351535894
sim_compute_sim_state_mean	0.03364937962786264
sim_compute_sim_state_median	0.037256676417130694
sim_compute_sim_state_min	0.026426009833812714
sim_physics_max	0.16913972451136663
sim_physics_mean	0.1296752865815166
sim_physics_median	0.13619668395430953
sim_physics_min	0.0994134921776621
sim_render-ego_max	0.06426821814643012
sim_render-ego_mean	0.05507105963285367
sim_render-ego_median	0.06147428353627523
sim_render-ego_min	0.042599014937877655
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.6499999999999977
survival_time_min	1.3500000000000003

No reset possible

20463

2587

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 13:30:05+00:00

2019-04-25 13:41:20+00:00

0:11:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.28700872162975877
survival_time_median	6.299999999999986
deviation-center-line_median	0.31984962308949866
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2628593210314141
agent_compute-ego_mean	0.24445174832344052
agent_compute-ego_median	0.24006908808567728
agent_compute-ego_min	0.2271996928799537
deviation-center-line_max	0.38506011297013665
deviation-center-line_mean	0.3283894598547435
deviation-center-line_min	0.27821459043464486
deviation-heading_max	2.8986707727377015
deviation-heading_mean	2.3317721031269074
deviation-heading_median	2.431782021756193
deviation-heading_min	1.4038285800049086
driven_any_max	0.43511096286974393
driven_any_mean	0.31205812595489074
driven_any_median	0.3406388393276546
driven_any_min	0.16798961025563436
driven_lanedir_consec_max	0.3948358334502423
driven_lanedir_consec_mean	0.26779992042192224
driven_lanedir_consec_min	0.13619959654232217
driven_lanedir_max	0.3948358334502423
driven_lanedir_mean	0.26779992042192224
driven_lanedir_median	0.28700872162975877
driven_lanedir_min	0.13619959654232217
in-drivable-lane_max	0.14999999999999947
in-drivable-lane_mean	0.029999999999999895
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3406388393276546, "sim_physics": 0.1136786975557842, "survival_time": 6.299999999999986, "driven_lanedir": 0.28700872162975877, "sim_render-ego": 0.06578324522290911, "in-drivable-lane": 0, "agent_compute-ego": 0.2537211122966948, "deviation-heading": 2.8986707727377015, "set_robot_commands": 0.10078255713932098, "deviation-center-line": 0.38506011297013665, "driven_lanedir_consec": 0.28700872162975877, "sim_compute_sim_state": 0.040976329455299984, "sim_compute_performance-ego": 0.07163478646959577, "sim_compute_robot_state-ego": 0.0818288383029756}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.43511096286974393, "sim_physics": 0.10078748118492864, "survival_time": 7.7499999999999805, "driven_lanedir": 0.3948358334502423, "sim_render-ego": 0.06139177814606697, "in-drivable-lane": 0, "agent_compute-ego": 0.2271996928799537, "deviation-heading": 2.431782021756193, "set_robot_commands": 0.0954432656688075, "deviation-center-line": 0.34781839390979646, "driven_lanedir_consec": 0.3948358334502423, "sim_compute_sim_state": 0.03846970065947502, "sim_compute_performance-ego": 0.06828287647616478, "sim_compute_robot_state-ego": 0.07155759872928742}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16798961025563436, "sim_physics": 0.106711567425337, "survival_time": 3.049999999999997, "driven_lanedir": 0.13619959654232217, "sim_render-ego": 0.06570189116431065, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.2628593210314141, "deviation-heading": 1.4038285800049086, "set_robot_commands": 0.10633422898464516, "deviation-center-line": 0.31100457886964067, "driven_lanedir_consec": 0.13619959654232217, "sim_compute_sim_state": 0.04188414479865402, "sim_compute_performance-ego": 0.07332036534293754, "sim_compute_robot_state-ego": 0.08085289548655025}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.25452818579538083, "sim_physics": 0.10638720880855214, "survival_time": 4.399999999999992, "driven_lanedir": 0.2017315134864668, "sim_render-ego": 0.06325929815118964, "in-drivable-lane": 0, "agent_compute-ego": 0.2384095273234627, "deviation-heading": 2.5927269399135495, "set_robot_commands": 0.10124701803380792, "deviation-center-line": 0.27821459043464486, "driven_lanedir_consec": 0.2017315134864668, "sim_compute_sim_state": 0.04143021865324541, "sim_compute_performance-ego": 0.06972950155084784, "sim_compute_robot_state-ego": 0.07698489319194447}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3620230315260398, "sim_physics": 0.10473597142123436, "survival_time": 6.449999999999985, "driven_lanedir": 0.3192239370008214, "sim_render-ego": 0.06422239126161088, "in-drivable-lane": 0, "agent_compute-ego": 0.24006908808567728, "deviation-heading": 2.3318522012221834, "set_robot_commands": 0.09837070546408956, "deviation-center-line": 0.31984962308949866, "driven_lanedir_consec": 0.3192239370008214, "sim_compute_sim_state": 0.040424945742584935, "sim_compute_performance-ego": 0.07136810103128123, "sim_compute_robot_state-ego": 0.07336687672045804}}
set_robot_commands_max	0.10633422898464516
set_robot_commands_mean	0.10043555505813422
set_robot_commands_median	0.10078255713932098
set_robot_commands_min	0.0954432656688075
sim_compute_performance-ego_max	0.07332036534293754
sim_compute_performance-ego_mean	0.07086712617416543
sim_compute_performance-ego_median	0.07136810103128123
sim_compute_performance-ego_min	0.06828287647616478
sim_compute_robot_state-ego_max	0.0818288383029756
sim_compute_robot_state-ego_mean	0.07691822048624317
sim_compute_robot_state-ego_median	0.07698489319194447
sim_compute_robot_state-ego_min	0.07155759872928742
sim_compute_sim_state_max	0.04188414479865402
sim_compute_sim_state_mean	0.040637067861851874
sim_compute_sim_state_median	0.040976329455299984
sim_compute_sim_state_min	0.03846970065947502
sim_physics_max	0.1136786975557842
sim_physics_mean	0.10646018527916726
sim_physics_median	0.10638720880855214
sim_physics_min	0.10078748118492864
sim_render-ego_max	0.06578324522290911
sim_render-ego_mean	0.06407172078921744
sim_render-ego_median	0.06422239126161088
sim_render-ego_min	0.06139177814606697
simulation-passed	1
survival_time_max	7.7499999999999805
survival_time_mean	5.589999999999987
survival_time_min	3.049999999999997

No reset possible

20435

2694

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 13:00:26+00:00

2019-04-25 13:29:44+00:00

0:29:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9318667331746746
survival_time_median	11.450000000000028
deviation-center-line_median	0.7272805911703651
in-drivable-lane_median	2.750000000000006

other stats

agent_compute-ego_max	0.08317935264716714
agent_compute-ego_mean	0.07867090448733088
agent_compute-ego_median	0.08099149506667565
agent_compute-ego_min	0.06926545309364249
deviation-center-line_max	0.9857144258550056
deviation-center-line_mean	0.8122728431666506
deviation-center-line_min	0.659402117378533
deviation-heading_max	6.311414365310983
deviation-heading_mean	4.844732133529984
deviation-heading_median	5.347698751158633
deviation-heading_min	1.8838593129411976
driven_any_max	2.3482721078944655
driven_any_mean	1.8922552357893072
driven_any_median	1.7860322925108902
driven_any_min	1.353535949799886
driven_lanedir_consec_max	1.252682469763197
driven_lanedir_consec_mean	0.8908436144582795
driven_lanedir_consec_min	0.4854871861237688
driven_lanedir_max	1.252682469763197
driven_lanedir_mean	1.117862445200821
driven_lanedir_median	1.1473916953356325
driven_lanedir_min	0.9019749741155608
in-drivable-lane_max	5.200000000000049
in-drivable-lane_mean	2.9400000000000226
in-drivable-lane_min	0.30000000000000426
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.353535949799886, "sim_physics": 0.184777274643634, "survival_time": 8.84999999999999, "driven_lanedir": 1.252682469763197, "sim_render-ego": 0.06967819208479197, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.08317935264716714, "deviation-heading": 1.8838593129411976, "set_robot_commands": 0.105597531054653, "deviation-center-line": 0.7272805911703651, "driven_lanedir_consec": 1.252682469763197, "sim_compute_sim_state": 0.04171184766090522, "sim_compute_performance-ego": 0.07496988975395591, "sim_compute_robot_state-ego": 0.08274484488923671, "sim_compute_robot_state-npc0": 0.0750628958987651, "sim_compute_robot_state-npc1": 0.07483337019796425, "sim_compute_robot_state-npc2": 0.07368932605463233, "sim_compute_robot_state-npc3": 0.0760583231004618}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.7860322925108902, "sim_physics": 0.201865844851498, "survival_time": 11.450000000000028, "driven_lanedir": 1.1473916953356325, "sim_render-ego": 0.0678564606795665, "in-drivable-lane": 2.4500000000000206, "agent_compute-ego": 0.08159674723596032, "deviation-heading": 4.4587912726623395, "set_robot_commands": 0.10724623130398546, "deviation-center-line": 0.659402117378533, "driven_lanedir_consec": 1.0180781140843669, "sim_compute_sim_state": 0.04176277572931681, "sim_compute_performance-ego": 0.0751934946884755, "sim_compute_robot_state-ego": 0.0837435576592991, "sim_compute_robot_state-npc0": 0.07816239527739813, "sim_compute_robot_state-npc1": 0.07587959152121732, "sim_compute_robot_state-npc2": 0.07627938824449564, "sim_compute_robot_state-npc3": 0.07585713332396928}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3482721078944655, "sim_physics": 0.2034532038370768, "survival_time": 14.950000000000076, "driven_lanedir": 1.0690064175432483, "sim_render-ego": 0.06506386359532675, "in-drivable-lane": 5.200000000000049, "agent_compute-ego": 0.07832147439320881, "deviation-heading": 6.221896965576764, "set_robot_commands": 0.10281717777252196, "deviation-center-line": 0.9857144258550056, "driven_lanedir_consec": 0.7661035691453901, "sim_compute_sim_state": 0.03969870011011759, "sim_compute_performance-ego": 0.07238119920094808, "sim_compute_robot_state-ego": 0.07886251529057821, "sim_compute_robot_state-npc0": 0.07301687637964885, "sim_compute_robot_state-npc1": 0.07233900229136149, "sim_compute_robot_state-npc2": 0.07211143414179484, "sim_compute_robot_state-npc3": 0.0724958856900533}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6976042497274832, "sim_physics": 0.15044962484902197, "survival_time": 10.90000000000002, "driven_lanedir": 0.9019749741155608, "sim_render-ego": 0.05559055520853865, "in-drivable-lane": 2.750000000000006, "agent_compute-ego": 0.06926545309364249, "deviation-heading": 5.347698751158633, "set_robot_commands": 0.08751845687901208, "deviation-center-line": 0.7146015552019714, "driven_lanedir_consec": 0.4854871861237688, "sim_compute_sim_state": 0.03477978925092505, "sim_compute_performance-ego": 0.06205744152769036, "sim_compute_robot_state-ego": 0.0662413091834532, "sim_compute_robot_state-npc0": 0.06368757934745299, "sim_compute_robot_state-npc1": 0.062322547676366406, "sim_compute_robot_state-npc2": 0.06382432115187339, "sim_compute_robot_state-npc3": 0.06235225266272869}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.2758315790138104, "sim_physics": 0.19375106301800957, "survival_time": 14.500000000000073, "driven_lanedir": 1.2182566692464654, "sim_render-ego": 0.06886774918128705, "in-drivable-lane": 4.000000000000033, "agent_compute-ego": 0.08099149506667565, "deviation-heading": 6.311414365310983, "set_robot_commands": 0.10420869136678762, "deviation-center-line": 0.974365526227378, "driven_lanedir_consec": 0.9318667331746746, "sim_compute_sim_state": 0.041397467974958746, "sim_compute_performance-ego": 0.07454860292632004, "sim_compute_robot_state-ego": 0.07856934810506887, "sim_compute_robot_state-npc0": 0.07285294614989182, "sim_compute_robot_state-npc1": 0.07325196595027529, "sim_compute_robot_state-npc2": 0.07302262783050537, "sim_compute_robot_state-npc3": 0.07223737404264252}}
set_robot_commands_max	0.10724623130398546
set_robot_commands_mean	0.10147761767539204
set_robot_commands_median	0.10420869136678762
set_robot_commands_min	0.08751845687901208
sim_compute_performance-ego_max	0.0751934946884755
sim_compute_performance-ego_mean	0.07183012561947798
sim_compute_performance-ego_median	0.07454860292632004
sim_compute_performance-ego_min	0.06205744152769036
sim_compute_robot_state-ego_max	0.0837435576592991
sim_compute_robot_state-ego_mean	0.07803231502552721
sim_compute_robot_state-ego_median	0.07886251529057821
sim_compute_robot_state-ego_min	0.0662413091834532
sim_compute_robot_state-npc0_max	0.07816239527739813
sim_compute_robot_state-npc0_mean	0.07255653861063138
sim_compute_robot_state-npc0_median	0.07301687637964885
sim_compute_robot_state-npc0_min	0.06368757934745299
sim_compute_robot_state-npc1_max	0.07587959152121732
sim_compute_robot_state-npc1_mean	0.07172529552743695
sim_compute_robot_state-npc1_median	0.07325196595027529
sim_compute_robot_state-npc1_min	0.062322547676366406
sim_compute_robot_state-npc2_max	0.07627938824449564
sim_compute_robot_state-npc2_mean	0.0717854194846603
sim_compute_robot_state-npc2_median	0.07302262783050537
sim_compute_robot_state-npc2_min	0.06382432115187339
sim_compute_robot_state-npc3_max	0.0760583231004618
sim_compute_robot_state-npc3_mean	0.07180019376397112
sim_compute_robot_state-npc3_median	0.0724958856900533
sim_compute_robot_state-npc3_min	0.06235225266272869
sim_compute_sim_state_max	0.04176277572931681
sim_compute_sim_state_mean	0.03987011614524468
sim_compute_sim_state_median	0.041397467974958746
sim_compute_sim_state_min	0.03477978925092505
sim_physics_max	0.2034532038370768
sim_physics_mean	0.18685940223984804
sim_physics_median	0.19375106301800957
sim_physics_min	0.15044962484902197
sim_render-ego_max	0.06967819208479197
sim_render-ego_mean	0.06541136414990219
sim_render-ego_median	0.0678564606795665
sim_render-ego_min	0.05559055520853865
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.130000000000038
survival_time_min	8.84999999999999

No reset possible

20419

2695

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 12:51:52+00:00

2019-04-25 13:00:08+00:00

0:08:16

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20419-494176', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20419-494176', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20419-494176', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20399

2698

challenge-aido_LF-baseline-duckietown

step1-simulation

timeout

2019-04-25 12:21:20+00:00

2019-04-25 12:50:59+00:00

0:29:39

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20392

2691

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:02:04+00:00

2019-04-25 12:20:45+00:00

0:18:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6647713851118868
survival_time_median	8.699999999999989
deviation-center-line_median	0.46537985112209457
in-drivable-lane_median	3.599999999999989

other stats

agent_compute-ego_max	0.09101596769395766
agent_compute-ego_mean	0.08689428344844372
agent_compute-ego_median	0.08848047653834025
agent_compute-ego_min	0.08179198900858561
deviation-center-line_max	1.0834258364343363
deviation-center-line_mean	0.5501722561045701
deviation-center-line_min	0.19317295833796977
deviation-heading_max	6.4757980257829715
deviation-heading_mean	3.5466129463199145
deviation-heading_median	3.749688212146556
deviation-heading_min	0.7941222535652368
driven_any_max	2.3484697542270796
driven_any_mean	1.4262913300044444
driven_any_median	1.3438626475734732
driven_any_min	0.4283433721411975
driven_lanedir_consec_max	0.955224111316992
driven_lanedir_consec_mean	0.6448004922836863
driven_lanedir_consec_min	0.3059372305665393
driven_lanedir_max	1.3653216874240606
driven_lanedir_mean	0.7925456686753724
driven_lanedir_median	0.6647713851118868
driven_lanedir_min	0.3059372305665393
in-drivable-lane_max	5.450000000000062
in-drivable-lane_mean	2.580000000000017
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3332604737870963, "sim_physics": 0.15601802984873453, "survival_time": 14.950000000000076, "driven_lanedir": 1.1296198422965018, "sim_render-ego": 0.07150755087534587, "in-drivable-lane": 5.450000000000062, "agent_compute-ego": 0.08848047653834025, "deviation-heading": 5.205523570866052, "set_robot_commands": 0.114979039033254, "deviation-center-line": 0.6241015777265998, "driven_lanedir_consec": 0.955224111316992, "sim_compute_sim_state": 0.043875327110290525, "sim_compute_performance-ego": 0.08090757528940837, "sim_compute_robot_state-ego": 0.09045726935068768}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3438626475734732, "sim_physics": 0.1484351733635212, "survival_time": 8.699999999999989, "driven_lanedir": 0.49707819797787345, "sim_render-ego": 0.07413674497056282, "in-drivable-lane": 3.599999999999989, "agent_compute-ego": 0.08944955091366823, "deviation-heading": 3.749688212146556, "set_robot_commands": 0.12083069757483472, "deviation-center-line": 0.38478105690185066, "driven_lanedir_consec": 0.37973663857854933, "sim_compute_sim_state": 0.04587213061321741, "sim_compute_performance-ego": 0.08342856237258034, "sim_compute_robot_state-ego": 0.09457386225119405}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6775204022933754, "sim_physics": 0.1202927840935005, "survival_time": 4.549999999999992, "driven_lanedir": 0.6647713851118868, "sim_render-ego": 0.07308390900328919, "in-drivable-lane": 0, "agent_compute-ego": 0.09101596769395766, "deviation-heading": 0.7941222535652368, "set_robot_commands": 0.11802081747369451, "deviation-center-line": 0.46537985112209457, "driven_lanedir_consec": 0.6647713851118868, "sim_compute_sim_state": 0.04570711838020073, "sim_compute_performance-ego": 0.08415394562941331, "sim_compute_robot_state-ego": 0.09269965087974465}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3484697542270796, "sim_physics": 0.1480347720781962, "survival_time": 14.950000000000076, "driven_lanedir": 1.3653216874240606, "sim_render-ego": 0.06759526650110881, "in-drivable-lane": 3.750000000000037, "agent_compute-ego": 0.08373343308766683, "deviation-heading": 6.4757980257829715, "set_robot_commands": 0.11502589146296184, "deviation-center-line": 1.0834258364343363, "driven_lanedir_consec": 0.918333095844464, "sim_compute_sim_state": 0.04275500297546387, "sim_compute_performance-ego": 0.07662462234497071, "sim_compute_robot_state-ego": 0.08635536193847657}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4283433721411975, "sim_physics": 0.12401068607966104, "survival_time": 2.9999999999999973, "driven_lanedir": 0.3059372305665393, "sim_render-ego": 0.06792083978652955, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.08179198900858561, "deviation-heading": 1.5079326692387605, "set_robot_commands": 0.11544712781906127, "deviation-center-line": 0.19317295833796977, "driven_lanedir_consec": 0.3059372305665393, "sim_compute_sim_state": 0.042767818768819174, "sim_compute_performance-ego": 0.0831092913945516, "sim_compute_robot_state-ego": 0.09338168303171794}}
set_robot_commands_max	0.12083069757483472
set_robot_commands_mean	0.11686071467276128
set_robot_commands_median	0.11544712781906127
set_robot_commands_min	0.114979039033254
sim_compute_performance-ego_max	0.08415394562941331
sim_compute_performance-ego_mean	0.08164479940618487
sim_compute_performance-ego_median	0.0831092913945516
sim_compute_performance-ego_min	0.07662462234497071
sim_compute_robot_state-ego_max	0.09457386225119405
sim_compute_robot_state-ego_mean	0.09149356549036416
sim_compute_robot_state-ego_median	0.09269965087974465
sim_compute_robot_state-ego_min	0.08635536193847657
sim_compute_sim_state_max	0.04587213061321741
sim_compute_sim_state_mean	0.04419547956959834
sim_compute_sim_state_median	0.043875327110290525
sim_compute_sim_state_min	0.04275500297546387
sim_physics_max	0.15601802984873453
sim_physics_mean	0.1393582890927227
sim_physics_median	0.1480347720781962
sim_physics_min	0.1202927840935005
sim_render-ego_max	0.07413674497056282
sim_render-ego_mean	0.07084886222736723
sim_render-ego_median	0.07150755087534587
sim_render-ego_min	0.06759526650110881
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.230000000000029
survival_time_min	2.9999999999999973

No reset possible

20370

2704

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 11:55:20+00:00

2019-04-25 12:00:08+00:00

0:04:48

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20370-313512', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20370-313512', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20370-313512', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20359

2725

jiang peng

test for ppo

step1-simulation

error

2019-04-25 11:53:13+00:00

2019-04-25 11:54:56+00:00

0:01:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20352

2739

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-25 11:51:02+00:00

2019-04-25 11:52:52+00:00

0:01:50

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20347

2750

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 11:48:44+00:00

2019-04-25 11:50:47+00:00

0:02:03

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20341

2759

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 11:38:54+00:00

2019-04-25 11:48:18+00:00

0:09:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3868568300517894
survival_time_median	2.5999999999999988
deviation-center-line_median	0.15225004755568958
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08487266081350821
agent_compute-ego_mean	0.08028360625639867
agent_compute-ego_median	0.08004988156832181
agent_compute-ego_min	0.07629094939482839
deviation-center-line_max	0.2226582868882649
deviation-center-line_mean	0.14955415747516515
deviation-center-line_min	0.07892312124490847
deviation-heading_max	0.6459861795320978
deviation-heading_mean	0.4218478130160275
deviation-heading_median	0.4137732464571467
deviation-heading_min	0.27336376225758874
driven_any_max	1.055875722117673
driven_any_mean	0.6977105716937329
driven_any_median	0.7159098475930167
driven_any_min	0.3467630612192843
driven_lanedir_consec_max	0.7088980300052077
driven_lanedir_consec_mean	0.48067012473886733
driven_lanedir_consec_min	0.32585193632314957
driven_lanedir_max	0.7088980300052077
driven_lanedir_mean	0.48067012473886733
driven_lanedir_median	0.3868568300517894
driven_lanedir_min	0.32585193632314957
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.6799999999999977
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.16171389190774216, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.06697547749469154, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.07629094939482839, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.10694335322631032, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.041146965403305855, "sim_compute_performance-ego": 0.07671299733613667, "sim_compute_robot_state-ego": 0.0814595379327473, "sim_compute_robot_state-npc0": 0.07523522251530697, "sim_compute_robot_state-npc1": 0.07471673112166555, "sim_compute_robot_state-npc2": 0.07598813270267687, "sim_compute_robot_state-npc3": 0.07450041331742939}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3784135552892568, "sim_physics": 0.18907325714826584, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3420775634537585, "sim_render-ego": 0.06524977833032608, "in-drivable-lane": 0, "agent_compute-ego": 0.07790807634592056, "deviation-heading": 0.6459861795320978, "set_robot_commands": 0.1084524393081665, "deviation-center-line": 0.10981437189709492, "driven_lanedir_consec": 0.3420775634537585, "sim_compute_sim_state": 0.04494632035493851, "sim_compute_performance-ego": 0.07275114953517914, "sim_compute_robot_state-ego": 0.0810900330543518, "sim_compute_robot_state-npc0": 0.07573657482862473, "sim_compute_robot_state-npc1": 0.07510798424482346, "sim_compute_robot_state-npc2": 0.07855379581451416, "sim_compute_robot_state-npc3": 0.07984775304794312}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7159098475930167, "sim_physics": 0.20324612580812895, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7088980300052077, "sim_render-ego": 0.07177025996721707, "in-drivable-lane": 0, "agent_compute-ego": 0.08229646315941444, "deviation-heading": 0.27336376225758874, "set_robot_commands": 0.1108967478458698, "deviation-center-line": 0.2226582868882649, "driven_lanedir_consec": 0.7088980300052077, "sim_compute_sim_state": 0.04230828010118925, "sim_compute_performance-ego": 0.0796606311431298, "sim_compute_robot_state-ego": 0.08934376789973332, "sim_compute_robot_state-npc0": 0.07599628888643704, "sim_compute_robot_state-npc1": 0.07483221017397367, "sim_compute_robot_state-npc2": 0.07676261204939622, "sim_compute_robot_state-npc3": 0.07634797921547523}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.055875722117673, "sim_physics": 0.18879780708215177, "survival_time": 3.899999999999994, "driven_lanedir": 0.6396662638604318, "sim_render-ego": 0.07165191112420498, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.08004988156832181, "deviation-heading": 0.4978669142965758, "set_robot_commands": 0.1118776614849384, "deviation-center-line": 0.15225004755568958, "driven_lanedir_consec": 0.6396662638604318, "sim_compute_sim_state": 0.041270644236833624, "sim_compute_performance-ego": 0.07581913471221924, "sim_compute_robot_state-ego": 0.09054136887574808, "sim_compute_robot_state-npc0": 0.0755167741041917, "sim_compute_robot_state-npc1": 0.07706270462427384, "sim_compute_robot_state-npc2": 0.07557877821800037, "sim_compute_robot_state-npc3": 0.07568385967841515}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3467630612192843, "sim_physics": 0.16632866859436035, "survival_time": 1.3500000000000003, "driven_lanedir": 0.32585193632314957, "sim_render-ego": 0.0719038203910545, "in-drivable-lane": 0, "agent_compute-ego": 0.08487266081350821, "deviation-heading": 0.4137732464571467, "set_robot_commands": 0.10950609489723488, "deviation-center-line": 0.07892312124490847, "driven_lanedir_consec": 0.32585193632314957, "sim_compute_sim_state": 0.042020965505529334, "sim_compute_performance-ego": 0.07912424758628563, "sim_compute_robot_state-ego": 0.08759415591204608, "sim_compute_robot_state-npc0": 0.07739927150585034, "sim_compute_robot_state-npc1": 0.07703336079915364, "sim_compute_robot_state-npc2": 0.07855160148055465, "sim_compute_robot_state-npc3": 0.0751709673139784}}
set_robot_commands_max	0.1118776614849384
set_robot_commands_mean	0.10953525935250397
set_robot_commands_median	0.10950609489723488
set_robot_commands_min	0.10694335322631032
sim_compute_performance-ego_max	0.0796606311431298
sim_compute_performance-ego_mean	0.07681363206259009
sim_compute_performance-ego_median	0.07671299733613667
sim_compute_performance-ego_min	0.07275114953517914
sim_compute_robot_state-ego_max	0.09054136887574808
sim_compute_robot_state-ego_mean	0.08600577273492531
sim_compute_robot_state-ego_median	0.08759415591204608
sim_compute_robot_state-ego_min	0.0810900330543518
sim_compute_robot_state-npc0_max	0.07739927150585034
sim_compute_robot_state-npc0_mean	0.07597682636808216
sim_compute_robot_state-npc0_median	0.07573657482862473
sim_compute_robot_state-npc0_min	0.07523522251530697
sim_compute_robot_state-npc1_max	0.07706270462427384
sim_compute_robot_state-npc1_mean	0.07575059819277803
sim_compute_robot_state-npc1_median	0.07510798424482346
sim_compute_robot_state-npc1_min	0.07471673112166555
sim_compute_robot_state-npc2_max	0.07855379581451416
sim_compute_robot_state-npc2_mean	0.07708698405302845
sim_compute_robot_state-npc2_median	0.07676261204939622
sim_compute_robot_state-npc2_min	0.07557877821800037
sim_compute_robot_state-npc3_max	0.07984775304794312
sim_compute_robot_state-npc3_mean	0.07631019451464827
sim_compute_robot_state-npc3_median	0.07568385967841515
sim_compute_robot_state-npc3_min	0.07450041331742939
sim_compute_sim_state_max	0.04494632035493851
sim_compute_sim_state_mean	0.04233863512035931
sim_compute_sim_state_median	0.042020965505529334
sim_compute_sim_state_min	0.041146965403305855
sim_physics_max	0.20324612580812895
sim_physics_mean	0.18183195010812983
sim_physics_median	0.18879780708215177
sim_physics_min	0.16171389190774216
sim_render-ego_max	0.0719038203910545
sim_render-ego_mean	0.06951024946149884
sim_render-ego_median	0.07165191112420498
sim_render-ego_min	0.06524977833032608
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.6499999999999977
survival_time_min	1.3500000000000003

No reset possible

20316

2813

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-25 11:31:11+00:00

2019-04-25 11:38:46+00:00

0:07:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15334348877271017
agent_compute-ego_mean	0.1353804008413792
agent_compute-ego_median	0.14016000054917246
agent_compute-ego_min	0.11511876623509294
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.16212726539036013, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.05641469865475061, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.14016000054917246, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.08517335945705198, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03512806037686906, "sim_compute_performance-ego": 0.06197542514441148, "sim_compute_robot_state-ego": 0.06678317852740018, "sim_compute_robot_state-npc0": 0.06326256832986507, "sim_compute_robot_state-npc1": 0.06176117906030619, "sim_compute_robot_state-npc2": 0.062472244478621576, "sim_compute_robot_state-npc3": 0.06190835979749572}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.15034016966819763, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.062843124071757, "in-drivable-lane": 0, "agent_compute-ego": 0.15334348877271017, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.09094465772310892, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03669326504071554, "sim_compute_performance-ego": 0.07579563061396281, "sim_compute_robot_state-ego": 0.07271238168080647, "sim_compute_robot_state-npc0": 0.06890697280565898, "sim_compute_robot_state-npc1": 0.06583335002263387, "sim_compute_robot_state-npc2": 0.06631144881248474, "sim_compute_robot_state-npc3": 0.06479377547899882}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.16770776247574112, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.04916174128904181, "in-drivable-lane": 0, "agent_compute-ego": 0.11882576295884988, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.07378966121350304, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.031007091877824168, "sim_compute_performance-ego": 0.053837945905782406, "sim_compute_robot_state-ego": 0.06053198798228118, "sim_compute_robot_state-npc0": 0.052158472901683746, "sim_compute_robot_state-npc1": 0.05410507573919781, "sim_compute_robot_state-npc2": 0.05250544871314097, "sim_compute_robot_state-npc3": 0.05349286531997939}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.14418618961916133, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.04706046944957668, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.11511876623509294, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.07012943494117867, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.029243533894167107, "sim_compute_performance-ego": 0.05165971335718187, "sim_compute_robot_state-ego": 0.05692394709182998, "sim_compute_robot_state-npc0": 0.051547575805146816, "sim_compute_robot_state-npc1": 0.05488050994226488, "sim_compute_robot_state-npc2": 0.05269704430790271, "sim_compute_robot_state-npc3": 0.052280438148369225}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.16176400184631348, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.06064656972885132, "in-drivable-lane": 0, "agent_compute-ego": 0.14945398569107057, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.09320785999298097, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.03760900497436523, "sim_compute_performance-ego": 0.06485869884490966, "sim_compute_robot_state-ego": 0.07420216798782349, "sim_compute_robot_state-npc0": 0.06471995115280152, "sim_compute_robot_state-npc1": 0.06560407876968384, "sim_compute_robot_state-npc2": 0.06337660551071167, "sim_compute_robot_state-npc3": 0.06303837299346923}}
set_robot_commands_max	0.09320785999298097
set_robot_commands_mean	0.08264899466556472
set_robot_commands_median	0.08517335945705198
set_robot_commands_min	0.07012943494117867
sim_compute_performance-ego_max	0.07579563061396281
sim_compute_performance-ego_mean	0.06162548277324964
sim_compute_performance-ego_median	0.06197542514441148
sim_compute_performance-ego_min	0.05165971335718187
sim_compute_robot_state-ego_max	0.07420216798782349
sim_compute_robot_state-ego_mean	0.06623073265402826
sim_compute_robot_state-ego_median	0.06678317852740018
sim_compute_robot_state-ego_min	0.05692394709182998
sim_compute_robot_state-npc0_max	0.06890697280565898
sim_compute_robot_state-npc0_mean	0.060119108199031226
sim_compute_robot_state-npc0_median	0.06326256832986507
sim_compute_robot_state-npc0_min	0.051547575805146816
sim_compute_robot_state-npc1_max	0.06583335002263387
sim_compute_robot_state-npc1_mean	0.06043683870681732
sim_compute_robot_state-npc1_median	0.06176117906030619
sim_compute_robot_state-npc1_min	0.05410507573919781
sim_compute_robot_state-npc2_max	0.06631144881248474
sim_compute_robot_state-npc2_mean	0.059472558364572325
sim_compute_robot_state-npc2_median	0.062472244478621576
sim_compute_robot_state-npc2_min	0.05250544871314097
sim_compute_robot_state-npc3_max	0.06479377547899882
sim_compute_robot_state-npc3_mean	0.05910276234766247
sim_compute_robot_state-npc3_median	0.06190835979749572
sim_compute_robot_state-npc3_min	0.052280438148369225
sim_compute_sim_state_max	0.03760900497436523
sim_compute_sim_state_mean	0.033936191232788224
sim_compute_sim_state_median	0.03512806037686906
sim_compute_sim_state_min	0.029243533894167107
sim_physics_max	0.16770776247574112
sim_physics_mean	0.15722507779995473
sim_physics_median	0.16176400184631348
sim_physics_min	0.14418618961916133
sim_render-ego_max	0.062843124071757
sim_render-ego_mean	0.05522532063879548
sim_render-ego_median	0.05641469865475061
sim_render-ego_min	0.04706046944957668
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20285

2872

Peter Almasi 🇭🇺

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 11:10:47+00:00

2019-04-25 11:30:38+00:00

0:19:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4104123964890949
survival_time_median	14.950000000000076
deviation-center-line_median	0.3823670182357231
in-drivable-lane_median	6.8500000000000405

other stats

agent_compute-ego_max	0.17614747859813548
agent_compute-ego_mean	0.16350235767717716
agent_compute-ego_median	0.1657829531033834
agent_compute-ego_min	0.14672845284144084
deviation-center-line_max	0.6687290985324333
deviation-center-line_mean	0.34103507774158015
deviation-center-line_min	0.07548350950033786
deviation-heading_max	6.159598520827866
deviation-heading_mean	4.900525177210745
deviation-heading_median	5.814157676807762
deviation-heading_min	0.6226208994177134
driven_any_max	1.2801096834301784
driven_any_mean	0.9737487592719442
driven_any_median	1.1252380356593414
driven_any_min	0.1044431936637462
driven_lanedir_consec_max	0.4168920462284187
driven_lanedir_consec_mean	0.3288529016156071
driven_lanedir_consec_min	0.03992641439920907
driven_lanedir_max	0.4168920462284187
driven_lanedir_mean	0.3288529016156071
driven_lanedir_median	0.4104123964890949
driven_lanedir_min	0.03992641439920907
in-drivable-lane_max	7.350000000000042
in-drivable-lane_mean	5.700000000000032
in-drivable-lane_min	0.40000000000000024
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2493060457871066, "sim_physics": 0.1284559750556946, "survival_time": 14.950000000000076, "driven_lanedir": 0.4104123964890949, "sim_render-ego": 0.06259026050567627, "in-drivable-lane": 6.8500000000000405, "agent_compute-ego": 0.1736734406153361, "deviation-heading": 6.159598520827866, "set_robot_commands": 0.09689380168914796, "deviation-center-line": 0.4216740606518701, "driven_lanedir_consec": 0.4104123964890949, "sim_compute_sim_state": 0.040182654857635496, "sim_compute_performance-ego": 0.07060407161712647, "sim_compute_robot_state-ego": 0.07846066554387411}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1252380356593414, "sim_physics": 0.11692856232325236, "survival_time": 14.950000000000076, "driven_lanedir": 0.4140680541696557, "sim_render-ego": 0.060914111932118736, "in-drivable-lane": 6.850000000000038, "agent_compute-ego": 0.1657829531033834, "deviation-heading": 6.099061157389506, "set_robot_commands": 0.09315744320551554, "deviation-center-line": 0.3823670182357231, "driven_lanedir_consec": 0.4140680541696557, "sim_compute_sim_state": 0.03950555721918742, "sim_compute_performance-ego": 0.06664289792378743, "sim_compute_robot_state-ego": 0.07343664725621542}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1044431936637462, "sim_physics": 0.09940816737987378, "survival_time": 1.3500000000000003, "driven_lanedir": 0.03992641439920907, "sim_render-ego": 0.06490415113943594, "in-drivable-lane": 0.40000000000000024, "agent_compute-ego": 0.17614747859813548, "deviation-heading": 0.6226208994177134, "set_robot_commands": 0.09697780785737214, "deviation-center-line": 0.07548350950033786, "driven_lanedir_consec": 0.03992641439920907, "sim_compute_sim_state": 0.04037484416255245, "sim_compute_performance-ego": 0.07364643944634332, "sim_compute_robot_state-ego": 0.0848345403318052}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1096468378193476, "sim_physics": 0.09898032903671264, "survival_time": 14.950000000000076, "driven_lanedir": 0.36296559679165696, "sim_render-ego": 0.051814321676890054, "in-drivable-lane": 7.350000000000042, "agent_compute-ego": 0.14672845284144084, "deviation-heading": 5.814157676807762, "set_robot_commands": 0.08067887385686238, "deviation-center-line": 0.1569217017875364, "driven_lanedir_consec": 0.36296559679165696, "sim_compute_sim_state": 0.03257502953211466, "sim_compute_performance-ego": 0.057501451174418135, "sim_compute_robot_state-ego": 0.061153121789296466}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2801096834301784, "sim_physics": 0.11190871079762776, "survival_time": 14.950000000000076, "driven_lanedir": 0.4168920462284187, "sim_render-ego": 0.05687643051147461, "in-drivable-lane": 7.050000000000041, "agent_compute-ego": 0.15517946322758994, "deviation-heading": 5.807187631610876, "set_robot_commands": 0.0879221248626709, "deviation-center-line": 0.6687290985324333, "driven_lanedir_consec": 0.4168920462284187, "sim_compute_sim_state": 0.035346195697784424, "sim_compute_performance-ego": 0.06304222663243611, "sim_compute_robot_state-ego": 0.06825448910395304}}
set_robot_commands_max	0.09697780785737214
set_robot_commands_mean	0.09112601029431378
set_robot_commands_median	0.09315744320551554
set_robot_commands_min	0.08067887385686238
sim_compute_performance-ego_max	0.07364643944634332
sim_compute_performance-ego_mean	0.06628741735882229
sim_compute_performance-ego_median	0.06664289792378743
sim_compute_performance-ego_min	0.057501451174418135
sim_compute_robot_state-ego_max	0.0848345403318052
sim_compute_robot_state-ego_mean	0.07322789280502884
sim_compute_robot_state-ego_median	0.07343664725621542
sim_compute_robot_state-ego_min	0.061153121789296466
sim_compute_sim_state_max	0.04037484416255245
sim_compute_sim_state_mean	0.03759685629385488
sim_compute_sim_state_median	0.03950555721918742
sim_compute_sim_state_min	0.03257502953211466
sim_physics_max	0.1284559750556946
sim_physics_mean	0.11113634891863224
sim_physics_median	0.11190871079762776
sim_physics_min	0.09898032903671264
sim_render-ego_max	0.06490415113943594
sim_render-ego_mean	0.05941985515311913
sim_render-ego_median	0.060914111932118736
sim_render-ego_min	0.051814321676890054
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.23000000000006
survival_time_min	1.3500000000000003

No reset possible

20268

2868

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 11:00:20+00:00

2019-04-25 11:10:31+00:00

0:10:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5628987359812423
survival_time_median	3.149999999999997
deviation-center-line_median	0.11495874773246945
in-drivable-lane_median	1.649999999999997

other stats

agent_compute-ego_max	0.18580377669561476
agent_compute-ego_mean	0.1748197390766603
agent_compute-ego_median	0.1722156000137329
agent_compute-ego_min	0.1653774996935311
deviation-center-line_max	0.1728875348094485
deviation-center-line_mean	0.12436808662885487
deviation-center-line_min	0.08230349446556157
deviation-heading_max	1.4476796412549486
deviation-heading_mean	0.6869673444978963
deviation-heading_median	0.5633865374909484
deviation-heading_min	0.18406291691333296
driven_any_max	1.796423994923684
driven_any_mean	1.408164234999773
driven_any_median	1.4026362809428787
driven_any_min	1.172259096398855
driven_lanedir_consec_max	0.6727594289029044
driven_lanedir_consec_mean	0.5060899140228177
driven_lanedir_consec_min	0.23303074528491008
driven_lanedir_max	0.6758592718907708
driven_lanedir_mean	0.5625557158192298
driven_lanedir_median	0.5628987359812423
driven_lanedir_min	0.4360814409830744
in-drivable-lane_max	2.5499999999999927
in-drivable-lane_mean	1.6299999999999966
in-drivable-lane_min	0.8999999999999984
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.796423994923684, "sim_physics": 0.09931669765048556, "survival_time": 4.499999999999992, "driven_lanedir": 0.6758592718907708, "sim_render-ego": 0.06350383493635389, "in-drivable-lane": 2.5499999999999927, "agent_compute-ego": 0.18525975545247397, "deviation-heading": 0.8327835264072544, "set_robot_commands": 0.09456873734792072, "deviation-center-line": 0.15141376881074753, "driven_lanedir_consec": 0.6256792189619569, "sim_compute_sim_state": 0.04070930745866563, "sim_compute_performance-ego": 0.0690776957405938, "sim_compute_robot_state-ego": 0.07119776407877604}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4026362809428787, "sim_physics": 0.10678150918748644, "survival_time": 3.149999999999997, "driven_lanedir": 0.4360814409830744, "sim_render-ego": 0.06586673146202451, "in-drivable-lane": 1.8499999999999976, "agent_compute-ego": 0.18580377669561476, "deviation-heading": 0.5633865374909484, "set_robot_commands": 0.09981673104422432, "deviation-center-line": 0.10027688732604752, "driven_lanedir_consec": 0.4360814409830744, "sim_compute_sim_state": 0.04060023550003294, "sim_compute_performance-ego": 0.07207272923181927, "sim_compute_robot_state-ego": 0.08068083581470308}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.172259096398855, "sim_physics": 0.0907437801361084, "survival_time": 3.399999999999996, "driven_lanedir": 0.4651797013381571, "sim_render-ego": 0.05947442966348985, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.1654420635279487, "deviation-heading": 1.4476796412549486, "set_robot_commands": 0.092390495188096, "deviation-center-line": 0.1728875348094485, "driven_lanedir_consec": 0.23303074528491008, "sim_compute_sim_state": 0.036952323773327994, "sim_compute_performance-ego": 0.06721543564515955, "sim_compute_robot_state-ego": 0.07169477729236379}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1792172191778258, "sim_physics": 0.09904301643371582, "survival_time": 2.499999999999999, "driven_lanedir": 0.6727594289029044, "sim_render-ego": 0.0580854320526123, "in-drivable-lane": 0.8999999999999984, "agent_compute-ego": 0.1722156000137329, "deviation-heading": 0.4069241004229971, "set_robot_commands": 0.0970670747756958, "deviation-center-line": 0.08230349446556157, "driven_lanedir_consec": 0.6727594289029044, "sim_compute_sim_state": 0.036869773864746096, "sim_compute_performance-ego": 0.06679469108581543, "sim_compute_robot_state-ego": 0.06997848510742187}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4902845835556202, "sim_physics": 0.10086552571442169, "survival_time": 2.9499999999999975, "driven_lanedir": 0.5628987359812423, "sim_render-ego": 0.0637627092458434, "in-drivable-lane": 1.649999999999997, "agent_compute-ego": 0.1653774996935311, "deviation-heading": 0.18406291691333296, "set_robot_commands": 0.08981462252342094, "deviation-center-line": 0.11495874773246945, "driven_lanedir_consec": 0.5628987359812423, "sim_compute_sim_state": 0.03646082797292936, "sim_compute_performance-ego": 0.0706812284760556, "sim_compute_robot_state-ego": 0.0696892172603284}}
set_robot_commands_max	0.09981673104422432
set_robot_commands_mean	0.09473153217587156
set_robot_commands_median	0.09456873734792072
set_robot_commands_min	0.08981462252342094
sim_compute_performance-ego_max	0.07207272923181927
sim_compute_performance-ego_mean	0.06916835603588874
sim_compute_performance-ego_median	0.0690776957405938
sim_compute_performance-ego_min	0.06679469108581543
sim_compute_robot_state-ego_max	0.08068083581470308
sim_compute_robot_state-ego_mean	0.07264821591071864
sim_compute_robot_state-ego_median	0.07119776407877604
sim_compute_robot_state-ego_min	0.0696892172603284
sim_compute_sim_state_max	0.04070930745866563
sim_compute_sim_state_mean	0.0383184937139404
sim_compute_sim_state_median	0.036952323773327994
sim_compute_sim_state_min	0.03646082797292936
sim_physics_max	0.10678150918748644
sim_physics_mean	0.09935010582444356
sim_physics_median	0.09931669765048556
sim_physics_min	0.0907437801361084
sim_render-ego_max	0.06586673146202451
sim_render-ego_mean	0.06213862747206479
sim_render-ego_median	0.06350383493635389
sim_render-ego_min	0.0580854320526123
simulation-passed	1
survival_time_max	4.499999999999992
survival_time_mean	3.299999999999996
survival_time_min	2.499999999999999

No reset possible

20257

2907

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 10:45:11+00:00

2019-04-25 11:00:06+00:00

0:14:55

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20257-204107', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20257-204107', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20257-204107', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20247

2920

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 10:39:10+00:00

2019-04-25 10:44:28+00:00

0:05:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09357765393480356
survival_time_median	1.800000000000001
deviation-center-line_median	0.05250895153434418
in-drivable-lane_median	0.5000000000000004

other stats

agent_compute-ego_max	0.17867839014207995
agent_compute-ego_mean	0.16760003972550597
agent_compute-ego_median	0.16584326161278615
agent_compute-ego_min	0.1580598787827925
deviation-center-line_max	0.10335809659227135
deviation-center-line_mean	0.06112259668786311
deviation-center-line_min	0.03365871022087044
deviation-heading_max	0.8302924722744389
deviation-heading_mean	0.7041421520808218
deviation-heading_median	0.693633189521797
deviation-heading_min	0.5275288153150017
driven_any_max	0.23626901202493045
driven_any_mean	0.20181769860013257
driven_any_median	0.20540992959401977
driven_any_min	0.1405312826112001
driven_lanedir_consec_max	0.1200341117435677
driven_lanedir_consec_mean	0.09809011745756416
driven_lanedir_consec_min	0.07857883757181128
driven_lanedir_max	0.1200341117435677
driven_lanedir_mean	0.09809011745756416
driven_lanedir_median	0.09357765393480356
driven_lanedir_min	0.07857883757181128
in-drivable-lane_max	0.5500000000000005
in-drivable-lane_mean	0.4200000000000004
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22749967710109037, "sim_physics": 0.10302184687720405, "survival_time": 1.800000000000001, "driven_lanedir": 0.08309205119878627, "sim_render-ego": 0.06426368157068889, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16584326161278615, "deviation-heading": 0.7771617891127819, "set_robot_commands": 0.09167273177040948, "deviation-center-line": 0.06564380668986448, "driven_lanedir_consec": 0.08309205119878627, "sim_compute_sim_state": 0.03721683555179172, "sim_compute_performance-ego": 0.07019421127107409, "sim_compute_robot_state-ego": 0.07315903239780003}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19937859166942196, "sim_physics": 0.09513253779024693, "survival_time": 1.850000000000001, "driven_lanedir": 0.09357765393480356, "sim_render-ego": 0.06018770063245619, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.17867839014207995, "deviation-heading": 0.6920944941800893, "set_robot_commands": 0.09102559089660645, "deviation-center-line": 0.03365871022087044, "driven_lanedir_consec": 0.09357765393480356, "sim_compute_sim_state": 0.03674849948367557, "sim_compute_performance-ego": 0.06379834381309715, "sim_compute_robot_state-ego": 0.06873927889643489}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1405312826112001, "sim_physics": 0.09501241553913464, "survival_time": 1.1000000000000003, "driven_lanedir": 0.11516793283885196, "sim_render-ego": 0.06011784076690674, "in-drivable-lane": 0, "agent_compute-ego": 0.1595769036899913, "deviation-heading": 0.5275288153150017, "set_robot_commands": 0.09675137563185258, "deviation-center-line": 0.10335809659227135, "driven_lanedir_consec": 0.11516793283885196, "sim_compute_sim_state": 0.03640494563362815, "sim_compute_performance-ego": 0.06679649786515669, "sim_compute_robot_state-ego": 0.07468105446208607}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.20540992959401977, "sim_physics": 0.10184092232675264, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07857883757181128, "sim_render-ego": 0.059296152808449486, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1580598787827925, "deviation-heading": 0.8302924722744389, "set_robot_commands": 0.0946890151861942, "deviation-center-line": 0.05250895153434418, "driven_lanedir_consec": 0.07857883757181128, "sim_compute_sim_state": 0.0373207222331654, "sim_compute_performance-ego": 0.06464546377008612, "sim_compute_robot_state-ego": 0.06947955940708969}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.23626901202493045, "sim_physics": 0.11644003265782406, "survival_time": 1.900000000000001, "driven_lanedir": 0.1200341117435677, "sim_render-ego": 0.0637220207013582, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17584176439987986, "deviation-heading": 0.693633189521797, "set_robot_commands": 0.100169627290023, "deviation-center-line": 0.050443418401965104, "driven_lanedir_consec": 0.1200341117435677, "sim_compute_sim_state": 0.038828297665244656, "sim_compute_performance-ego": 0.07532523807726409, "sim_compute_robot_state-ego": 0.0829976106944837}}
set_robot_commands_max	0.100169627290023
set_robot_commands_mean	0.09486166815501716
set_robot_commands_median	0.0946890151861942
set_robot_commands_min	0.09102559089660645
sim_compute_performance-ego_max	0.07532523807726409
sim_compute_performance-ego_mean	0.06815195095933563
sim_compute_performance-ego_median	0.06679649786515669
sim_compute_performance-ego_min	0.06379834381309715
sim_compute_robot_state-ego_max	0.0829976106944837
sim_compute_robot_state-ego_mean	0.07381130717157888
sim_compute_robot_state-ego_median	0.07315903239780003
sim_compute_robot_state-ego_min	0.06873927889643489
sim_compute_sim_state_max	0.038828297665244656
sim_compute_sim_state_mean	0.0373038601135011
sim_compute_sim_state_median	0.03721683555179172
sim_compute_sim_state_min	0.03640494563362815
sim_physics_max	0.11644003265782406
sim_physics_mean	0.10228955103823244
sim_physics_median	0.10184092232675264
sim_physics_min	0.09501241553913464
sim_render-ego_max	0.06426368157068889
sim_render-ego_mean	0.0615174792959719
sim_render-ego_median	0.06018770063245619
sim_render-ego_min	0.059296152808449486
simulation-passed	1
survival_time_max	1.900000000000001
survival_time_mean	1.6600000000000008
survival_time_min	1.1000000000000003

No reset possible

20242

2933

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 10:37:58+00:00

2019-04-25 10:38:36+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20236

2949

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 10:32:00+00:00

2019-04-25 10:37:26+00:00

0:05:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.16906733212144243
survival_time_median	1.4500000000000006
deviation-center-line_median	0.09957635300552904
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17216521104176838
agent_compute-ego_mean	0.15839776244108705
agent_compute-ego_median	0.1665886688232422
agent_compute-ego_min	0.12077603340148926
deviation-center-line_max	0.12818778214416238
deviation-center-line_mean	0.1034061348701369
deviation-center-line_min	0.06913287681778958
deviation-heading_max	0.9398011974642644
deviation-heading_mean	0.6721646388280237
deviation-heading_median	0.6687394907660925
deviation-heading_min	0.38333987555385446
driven_any_max	0.24898449202563172
driven_any_mean	0.22531311883695643
driven_any_median	0.2283973386861123
driven_any_min	0.18902197960506392
driven_lanedir_consec_max	0.21878566292873416
driven_lanedir_consec_mean	0.17579848628239592
driven_lanedir_consec_min	0.14245662074066834
driven_lanedir_max	0.21878566292873416
driven_lanedir_mean	0.17579848628239592
driven_lanedir_median	0.16906733212144243
driven_lanedir_min	0.14245662074066834
in-drivable-lane_max	0.05000000000000005
in-drivable-lane_mean	0.010000000000000007
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2283973386861123, "sim_physics": 0.16250876585642496, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14245662074066834, "sim_render-ego": 0.06564939022064209, "in-drivable-lane": 0, "agent_compute-ego": 0.17216521104176838, "deviation-heading": 0.9398011974642644, "set_robot_commands": 0.09963821570078532, "deviation-center-line": 0.09957635300552904, "driven_lanedir_consec": 0.14245662074066834, "sim_compute_sim_state": 0.03856344223022461, "sim_compute_performance-ego": 0.06983818213144938, "sim_compute_robot_state-ego": 0.07797890504201253, "sim_compute_robot_state-npc0": 0.0693262497584025, "sim_compute_robot_state-npc1": 0.07137335141499837, "sim_compute_robot_state-npc2": 0.07063145637512207, "sim_compute_robot_state-npc3": 0.07240042686462403}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2337817560630295, "sim_physics": 0.1513445706203066, "survival_time": 1.4500000000000006, "driven_lanedir": 0.16906733212144243, "sim_render-ego": 0.0601693268479972, "in-drivable-lane": 0, "agent_compute-ego": 0.16665813840668778, "deviation-heading": 0.91578621603701, "set_robot_commands": 0.08966852056569066, "deviation-center-line": 0.09606799425782955, "driven_lanedir_consec": 0.16906733212144243, "sim_compute_sim_state": 0.039645564967188344, "sim_compute_performance-ego": 0.0668134278264539, "sim_compute_robot_state-ego": 0.07442283630371094, "sim_compute_robot_state-npc0": 0.06588695789205617, "sim_compute_robot_state-npc1": 0.06565294594600282, "sim_compute_robot_state-npc2": 0.06963517748076341, "sim_compute_robot_state-npc3": 0.07040535170456459}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.24898449202563172, "sim_physics": 0.11054805119832356, "survival_time": 1.5000000000000009, "driven_lanedir": 0.21878566292873416, "sim_render-ego": 0.04897058804829915, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.12077603340148926, "deviation-heading": 0.38333987555385446, "set_robot_commands": 0.06442232926686604, "deviation-center-line": 0.12818778214416238, "driven_lanedir_consec": 0.21878566292873416, "sim_compute_sim_state": 0.030500356356302896, "sim_compute_performance-ego": 0.04890827337900797, "sim_compute_robot_state-ego": 0.055153663953145346, "sim_compute_robot_state-npc0": 0.05110295613606771, "sim_compute_robot_state-npc1": 0.05159118175506592, "sim_compute_robot_state-npc2": 0.051189613342285153, "sim_compute_robot_state-npc3": 0.05176693598429362}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.22638002780494468, "sim_physics": 0.1653449042090054, "survival_time": 1.4500000000000006, "driven_lanedir": 0.20110206072728332, "sim_render-ego": 0.06328571253809435, "in-drivable-lane": 0, "agent_compute-ego": 0.1658007605322476, "deviation-heading": 0.4531564143188967, "set_robot_commands": 0.08703655210034601, "deviation-center-line": 0.12406566812537388, "driven_lanedir_consec": 0.20110206072728332, "sim_compute_sim_state": 0.03443958019388133, "sim_compute_performance-ego": 0.06494999754017797, "sim_compute_robot_state-ego": 0.07258963584899902, "sim_compute_robot_state-npc0": 0.062452439604134394, "sim_compute_robot_state-npc1": 0.06503275345111716, "sim_compute_robot_state-npc2": 0.06289811792044804, "sim_compute_robot_state-npc3": 0.0670133376943654}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18902197960506392, "sim_physics": 0.13272933959960936, "survival_time": 1.2500000000000004, "driven_lanedir": 0.14758075489385136, "sim_render-ego": 0.0586054515838623, "in-drivable-lane": 0, "agent_compute-ego": 0.1665886688232422, "deviation-heading": 0.6687394907660925, "set_robot_commands": 0.091829252243042, "deviation-center-line": 0.06913287681778958, "driven_lanedir_consec": 0.14758075489385136, "sim_compute_sim_state": 0.03540515899658203, "sim_compute_performance-ego": 0.06701976776123048, "sim_compute_robot_state-ego": 0.06935091018676758, "sim_compute_robot_state-npc0": 0.06562919616699218, "sim_compute_robot_state-npc1": 0.06366986274719239, "sim_compute_robot_state-npc2": 0.06434739112854004, "sim_compute_robot_state-npc3": 0.06397013664245606}}
set_robot_commands_max	0.09963821570078532
set_robot_commands_mean	0.086518973975346
set_robot_commands_median	0.08966852056569066
set_robot_commands_min	0.06442232926686604
sim_compute_performance-ego_max	0.06983818213144938
sim_compute_performance-ego_mean	0.06350592972766393
sim_compute_performance-ego_median	0.0668134278264539
sim_compute_performance-ego_min	0.04890827337900797
sim_compute_robot_state-ego_max	0.07797890504201253
sim_compute_robot_state-ego_mean	0.06989919026692709
sim_compute_robot_state-ego_median	0.07258963584899902
sim_compute_robot_state-ego_min	0.055153663953145346
sim_compute_robot_state-npc0_max	0.0693262497584025
sim_compute_robot_state-npc0_mean	0.0628795599115306
sim_compute_robot_state-npc0_median	0.06562919616699218
sim_compute_robot_state-npc0_min	0.05110295613606771
sim_compute_robot_state-npc1_max	0.07137335141499837
sim_compute_robot_state-npc1_mean	0.06346401906287533
sim_compute_robot_state-npc1_median	0.06503275345111716
sim_compute_robot_state-npc1_min	0.05159118175506592
sim_compute_robot_state-npc2_max	0.07063145637512207
sim_compute_robot_state-npc2_mean	0.06374035124943174
sim_compute_robot_state-npc2_median	0.06434739112854004
sim_compute_robot_state-npc2_min	0.051189613342285153
sim_compute_robot_state-npc3_max	0.07240042686462403
sim_compute_robot_state-npc3_mean	0.06511123777806074
sim_compute_robot_state-npc3_median	0.0670133376943654
sim_compute_robot_state-npc3_min	0.05176693598429362
sim_compute_sim_state_max	0.039645564967188344
sim_compute_sim_state_mean	0.03571082054883584
sim_compute_sim_state_median	0.03540515899658203
sim_compute_sim_state_min	0.030500356356302896
sim_physics_max	0.1653449042090054
sim_physics_mean	0.14449512629673394
sim_physics_median	0.1513445706203066
sim_physics_min	0.11054805119832356
sim_render-ego_max	0.06564939022064209
sim_render-ego_mean	0.05933609384777903
sim_render-ego_median	0.0601693268479972
sim_render-ego_min	0.04897058804829915
simulation-passed	1
survival_time_max	1.5000000000000009
survival_time_mean	1.4300000000000004
survival_time_min	1.2500000000000004

No reset possible

20227

2970

Andrea Censi 🇨🇭

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 10:19:26+00:00

2019-04-25 10:30:45+00:00

0:11:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.658141340093886
survival_time_median	6.999999999999983
deviation-center-line_median	0.3805179887067449
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.15639053143953022
agent_compute-ego_mean	0.1446261979533319
agent_compute-ego_median	0.14367215292794364
agent_compute-ego_min	0.13451035670970443
deviation-center-line_max	0.8219069617270801
deviation-center-line_mean	0.4622890220224802
deviation-center-line_min	0.240946508088056
deviation-heading_max	1.819384597985526
deviation-heading_mean	0.9470500519861752
deviation-heading_median	0.8064348941516836
deviation-heading_min	0.5022393903257442
driven_any_max	1.5790906665051212
driven_any_mean	0.90897363561738
driven_any_median	0.9970530395825568
driven_any_min	0.2870933095253068
driven_lanedir_consec_max	1.1522212258289768
driven_lanedir_consec_mean	0.7286312661816596
driven_lanedir_consec_min	0.2804952221609298
driven_lanedir_max	1.1522212258289768
driven_lanedir_mean	0.7286312661816596
driven_lanedir_median	0.658141340093886
driven_lanedir_min	0.2804952221609298
in-drivable-lane_max	2.80000000000004
in-drivable-lane_mean	1.0400000000000065
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9970530395825568, "sim_physics": 0.10864644050598143, "survival_time": 6.999999999999983, "driven_lanedir": 0.658141340093886, "sim_render-ego": 0.06049351692199707, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.14367215292794364, "deviation-heading": 0.8064348941516836, "set_robot_commands": 0.09550464493887766, "deviation-center-line": 0.3310166859136158, "driven_lanedir_consec": 0.658141340093886, "sim_compute_sim_state": 0.03872790336608887, "sim_compute_performance-ego": 0.0687545759337289, "sim_compute_robot_state-ego": 0.07380129609789167}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.018001036910281, "sim_physics": 0.11343617338529775, "survival_time": 7.099999999999983, "driven_lanedir": 0.9032065052271656, "sim_render-ego": 0.06085931079488405, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.14806499111820276, "deviation-heading": 1.819384597985526, "set_robot_commands": 0.09447142104027977, "deviation-center-line": 0.5370569656769042, "driven_lanedir_consec": 0.9032065052271656, "sim_compute_sim_state": 0.039172306866712976, "sim_compute_performance-ego": 0.06937941698960855, "sim_compute_robot_state-ego": 0.0766405119022853}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2870933095253068, "sim_physics": 0.09697764334471327, "survival_time": 2.3, "driven_lanedir": 0.2804952221609298, "sim_render-ego": 0.06028275904448136, "in-drivable-lane": 0, "agent_compute-ego": 0.14049295757127844, "deviation-heading": 0.5022393903257442, "set_robot_commands": 0.08839327356089717, "deviation-center-line": 0.240946508088056, "driven_lanedir_consec": 0.2804952221609298, "sim_compute_sim_state": 0.035263144451638924, "sim_compute_performance-ego": 0.06372858130413553, "sim_compute_robot_state-ego": 0.06588390080825142}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6636301255636338, "sim_physics": 0.10117072306181256, "survival_time": 4.749999999999991, "driven_lanedir": 0.6490920375973404, "sim_render-ego": 0.06262420353136565, "in-drivable-lane": 0, "agent_compute-ego": 0.15639053143953022, "deviation-heading": 0.9802944231598162, "set_robot_commands": 0.09600782645376103, "deviation-center-line": 0.3805179887067449, "driven_lanedir_consec": 0.6490920375973404, "sim_compute_sim_state": 0.03880926684329384, "sim_compute_performance-ego": 0.06789687307257401, "sim_compute_robot_state-ego": 0.07570932789852744}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5790906665051212, "sim_physics": 0.10867812446734872, "survival_time": 10.85000000000002, "driven_lanedir": 1.1522212258289768, "sim_render-ego": 0.05507354802250312, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.13451035670970443, "deviation-heading": 0.626896954308107, "set_robot_commands": 0.08535670025557417, "deviation-center-line": 0.8219069617270801, "driven_lanedir_consec": 1.1522212258289768, "sim_compute_sim_state": 0.0357167731781709, "sim_compute_performance-ego": 0.060657590215656615, "sim_compute_robot_state-ego": 0.0643521420966645}}
set_robot_commands_max	0.09600782645376103
set_robot_commands_mean	0.09194677324987796
set_robot_commands_median	0.09447142104027977
set_robot_commands_min	0.08535670025557417
sim_compute_performance-ego_max	0.06937941698960855
sim_compute_performance-ego_mean	0.06608340750314072
sim_compute_performance-ego_median	0.06789687307257401
sim_compute_performance-ego_min	0.060657590215656615
sim_compute_robot_state-ego_max	0.0766405119022853
sim_compute_robot_state-ego_mean	0.07127743576072407
sim_compute_robot_state-ego_median	0.07380129609789167
sim_compute_robot_state-ego_min	0.0643521420966645
sim_compute_sim_state_max	0.039172306866712976
sim_compute_sim_state_mean	0.0375378789411811
sim_compute_sim_state_median	0.03872790336608887
sim_compute_sim_state_min	0.035263144451638924
sim_physics_max	0.11343617338529775
sim_physics_mean	0.10578182095303076
sim_physics_median	0.10864644050598143
sim_physics_min	0.09697764334471327
sim_render-ego_max	0.06262420353136565
sim_render-ego_mean	0.059866667663046255
sim_render-ego_median	0.06049351692199707
sim_render-ego_min	0.05507354802250312
simulation-passed	1
survival_time_max	10.85000000000002
survival_time_mean	6.399999999999995
survival_time_min	2.3

No reset possible

20179

2903

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 10:02:11+00:00

2019-04-25 10:18:56+00:00

0:16:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6699773672467271
survival_time_median	6.0499999999999865
deviation-center-line_median	0.229899226066568
in-drivable-lane_median	1.649999999999994

other stats

agent_compute-ego_max	0.24166142433247667
agent_compute-ego_mean	0.2272472622363133
agent_compute-ego_median	0.2219319877953365
agent_compute-ego_min	0.21691269777259048
deviation-center-line_max	0.33200513240079416
deviation-center-line_mean	0.25246480809050187
deviation-center-line_min	0.17540795706044726
deviation-heading_max	0.9790641013510608
deviation-heading_mean	0.8701751539195021
deviation-heading_median	0.8945367309999577
deviation-heading_min	0.6544130411221329
driven_any_max	1.5837655171879133
driven_any_mean	0.9967634709043114
driven_any_median	0.9985104509106004
driven_any_min	0.36957986101741647
driven_lanedir_consec_max	1.2126165128061182
driven_lanedir_consec_mean	0.7748171949490297
driven_lanedir_consec_min	0.3564231903346198
driven_lanedir_max	1.2126165128061182
driven_lanedir_mean	0.7748171949490297
driven_lanedir_median	0.6699773672467271
driven_lanedir_min	0.3564231903346198
in-drivable-lane_max	2.000000000000017
in-drivable-lane_mean	1.1300000000000057
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9985104509106004, "sim_physics": 0.1468469269019513, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6699773672467271, "sim_render-ego": 0.05844446056145282, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.21773357233725305, "deviation-heading": 0.9574120111091808, "set_robot_commands": 0.09071944961863115, "deviation-center-line": 0.229899226066568, "driven_lanedir_consec": 0.6699773672467271, "sim_compute_sim_state": 0.03834188477066923, "sim_compute_performance-ego": 0.06844531603095945, "sim_compute_robot_state-ego": 0.06906090689099524, "sim_compute_robot_state-npc0": 0.06813171678338169, "sim_compute_robot_state-npc1": 0.06900718586503966, "sim_compute_robot_state-npc2": 0.06622152092043034, "sim_compute_robot_state-npc3": 0.06668735732716963}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.44819600873020937, "sim_physics": 0.16234694678207923, "survival_time": 2.8999999999999977, "driven_lanedir": 0.42283353982338934, "sim_render-ego": 0.06033893289237187, "in-drivable-lane": 0, "agent_compute-ego": 0.2219319877953365, "deviation-heading": 0.9790641013510608, "set_robot_commands": 0.09364784586018528, "deviation-center-line": 0.20734549402173744, "driven_lanedir_consec": 0.42283353982338934, "sim_compute_sim_state": 0.040014509497017695, "sim_compute_performance-ego": 0.06944971249021333, "sim_compute_robot_state-ego": 0.07275004633541765, "sim_compute_robot_state-npc0": 0.06988215035405652, "sim_compute_robot_state-npc1": 0.0696434604710546, "sim_compute_robot_state-npc2": 0.07020417986244991, "sim_compute_robot_state-npc3": 0.06883499129065151}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5837655171879133, "sim_physics": 0.171324814887757, "survival_time": 9.4, "driven_lanedir": 1.212235364534294, "sim_render-ego": 0.06130147107104038, "in-drivable-lane": 2.000000000000017, "agent_compute-ego": 0.23799662894391, "deviation-heading": 0.8945367309999577, "set_robot_commands": 0.09690199126588538, "deviation-center-line": 0.33200513240079416, "driven_lanedir_consec": 1.212235364534294, "sim_compute_sim_state": 0.03936809047739556, "sim_compute_performance-ego": 0.06778414705966382, "sim_compute_robot_state-ego": 0.07412453281118515, "sim_compute_robot_state-npc0": 0.0690093623830917, "sim_compute_robot_state-npc1": 0.0692337878206943, "sim_compute_robot_state-npc2": 0.06930732219777208, "sim_compute_robot_state-npc3": 0.06893040651970721}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.583765516675418, "sim_physics": 0.17720491201319594, "survival_time": 9.4, "driven_lanedir": 1.2126165128061182, "sim_render-ego": 0.06303746903196294, "in-drivable-lane": 2.000000000000017, "agent_compute-ego": 0.24166142433247667, "deviation-heading": 0.8654498850151784, "set_robot_commands": 0.09722344545607872, "deviation-center-line": 0.3176662309029626, "driven_lanedir_consec": 1.2126165128061182, "sim_compute_sim_state": 0.04080974548421008, "sim_compute_performance-ego": 0.06851981802189604, "sim_compute_robot_state-ego": 0.07660498644443269, "sim_compute_robot_state-npc0": 0.06953124670272177, "sim_compute_robot_state-npc1": 0.06891042247731635, "sim_compute_robot_state-npc2": 0.06913616936257545, "sim_compute_robot_state-npc3": 0.06841110168619359}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.36957986101741647, "sim_physics": 0.14384182618588817, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3564231903346198, "sim_render-ego": 0.060240628767986686, "in-drivable-lane": 0, "agent_compute-ego": 0.21691269777259048, "deviation-heading": 0.6544130411221329, "set_robot_commands": 0.09211030784918338, "deviation-center-line": 0.17540795706044726, "driven_lanedir_consec": 0.3564231903346198, "sim_compute_sim_state": 0.0382627078465053, "sim_compute_performance-ego": 0.06482920354726363, "sim_compute_robot_state-ego": 0.07466411590576172, "sim_compute_robot_state-npc0": 0.06779817172459193, "sim_compute_robot_state-npc1": 0.06518532305347677, "sim_compute_robot_state-npc2": 0.06928800076854472, "sim_compute_robot_state-npc3": 0.06918337393780144}}
set_robot_commands_max	0.09722344545607872
set_robot_commands_mean	0.09412060800999278
set_robot_commands_median	0.09364784586018528
set_robot_commands_min	0.09071944961863115
sim_compute_performance-ego_max	0.06944971249021333
sim_compute_performance-ego_mean	0.06780563942999926
sim_compute_performance-ego_median	0.06844531603095945
sim_compute_performance-ego_min	0.06482920354726363
sim_compute_robot_state-ego_max	0.07660498644443269
sim_compute_robot_state-ego_mean	0.07344091767755849
sim_compute_robot_state-ego_median	0.07412453281118515
sim_compute_robot_state-ego_min	0.06906090689099524
sim_compute_robot_state-npc0_max	0.06988215035405652
sim_compute_robot_state-npc0_mean	0.06887052958956871
sim_compute_robot_state-npc0_median	0.0690093623830917
sim_compute_robot_state-npc0_min	0.06779817172459193
sim_compute_robot_state-npc1_max	0.0696434604710546
sim_compute_robot_state-npc1_mean	0.06839603593751634
sim_compute_robot_state-npc1_median	0.06900718586503966
sim_compute_robot_state-npc1_min	0.06518532305347677
sim_compute_robot_state-npc2_max	0.07020417986244991
sim_compute_robot_state-npc2_mean	0.0688314386223545
sim_compute_robot_state-npc2_median	0.06928800076854472
sim_compute_robot_state-npc2_min	0.06622152092043034
sim_compute_robot_state-npc3_max	0.06918337393780144
sim_compute_robot_state-npc3_mean	0.06840944615230468
sim_compute_robot_state-npc3_median	0.06883499129065151
sim_compute_robot_state-npc3_min	0.06668735732716963
sim_compute_sim_state_max	0.04080974548421008
sim_compute_sim_state_mean	0.03935938761515957
sim_compute_sim_state_median	0.03936809047739556
sim_compute_sim_state_min	0.0382627078465053
sim_physics_max	0.17720491201319594
sim_physics_mean	0.1603130853541743
sim_physics_median	0.16234694678207923
sim_physics_min	0.14384182618588817
sim_render-ego_max	0.06303746903196294
sim_render-ego_mean	0.06067259246496294
sim_render-ego_median	0.06033893289237187
sim_render-ego_min	0.05844446056145282
simulation-passed	1
survival_time_max	9.4
survival_time_mean	6.0399999999999965
survival_time_min	2.4499999999999993

No reset possible

20167

2661

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 09:59:11+00:00

2019-04-25 10:00:16+00:00

0:01:05

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20167-803151', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20167-803151', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20167-803151', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20102

3063

Andrea Censi 🇨🇭

rotation

step1-simulation

success

2019-04-25 09:27:21+00:00

2019-04-25 09:59:03+00:00

0:31:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.00030327325308765474
survival_time_median	14.950000000000076
deviation-center-line_median	0.4782429075334328
in-drivable-lane_median	7.650000000000043

other stats

agent_compute-ego_max	0.1509856677055359
agent_compute-ego_mean	0.14703900384902954
agent_compute-ego_median	0.14842018524805706
agent_compute-ego_min	0.1425968114535014
deviation-center-line_max	0.6209554143640683
deviation-center-line_mean	0.41722590967444423
deviation-center-line_min	0.025329293139968057
deviation-heading_max	5.820018247123898
deviation-heading_mean	5.664655239940049
deviation-heading_median	5.766106818286449
deviation-heading_min	5.484319536528106
driven_any_max	0.028934981635122085
driven_any_mean	0.026549538326380497
driven_any_median	0.02595836365425521
driven_any_min	0.024158897917015212
driven_lanedir_consec_max	0.002757206308041882
driven_lanedir_consec_mean	-0.0001911202930098277
driven_lanedir_consec_min	-0.004297677691446733
driven_lanedir_max	0.002757206308041882
driven_lanedir_mean	-0.0001911202930098277
driven_lanedir_median	0.00030327325308765474
driven_lanedir_min	-0.004297677691446733
in-drivable-lane_max	7.650000000000044
in-drivable-lane_mean	7.630000000000043
in-drivable-lane_min	7.550000000000042
per-episodes	details {"udem1-0-0": {"driven_any": 0.028934981635122085, "sim_physics": 0.07449986457824707, "survival_time": 14.950000000000076, "driven_lanedir": 0.002757206308041882, "sim_render-ego": 0.06156574249267578, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.1509856677055359, "deviation-heading": 5.767844541062103, "set_robot_commands": 0.09167600313822429, "deviation-center-line": 0.5560677639275999, "driven_lanedir_consec": 0.002757206308041882, "sim_compute_sim_state": 0.03741787195205688, "sim_compute_performance-ego": 0.0662910795211792, "sim_compute_robot_state-ego": 0.07034743309020997, "sim_compute_robot_state-npc0": 0.06748725255330404, "sim_compute_robot_state-npc1": 0.06896541198094686, "sim_compute_robot_state-npc2": 0.06726577440897624, "sim_compute_robot_state-npc3": 0.06692586263020833}, "udem1-1-0": {"driven_any": 0.02595836365425521, "sim_physics": 0.0753757643699646, "survival_time": 14.950000000000076, "driven_lanedir": -0.004297677691446733, "sim_render-ego": 0.0615297015508016, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.14842018524805706, "deviation-heading": 5.820018247123898, "set_robot_commands": 0.09246764580408733, "deviation-center-line": 0.6209554143640683, "driven_lanedir_consec": -0.004297677691446733, "sim_compute_sim_state": 0.03840984265009562, "sim_compute_performance-ego": 0.0661583924293518, "sim_compute_robot_state-ego": 0.07030797640482585, "sim_compute_robot_state-npc0": 0.06781167984008789, "sim_compute_robot_state-npc1": 0.06803478082021078, "sim_compute_robot_state-npc2": 0.06518548806508383, "sim_compute_robot_state-npc3": 0.06685135046641032}, "udem1-2-0": {"driven_any": 0.025754651142354812, "sim_physics": 0.07064336458841959, "survival_time": 14.950000000000076, "driven_lanedir": 0.0025028109383136155, "sim_render-ego": 0.056350150903066, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.1425968114535014, "deviation-heading": 5.4849870566996906, "set_robot_commands": 0.08777514298756918, "deviation-center-line": 0.4782429075334328, "driven_lanedir_consec": 0.0025028109383136155, "sim_compute_sim_state": 0.03509967009226481, "sim_compute_performance-ego": 0.06436359564463298, "sim_compute_robot_state-ego": 0.06612100919087728, "sim_compute_robot_state-npc0": 0.06267067988713583, "sim_compute_robot_state-npc1": 0.061491798559824624, "sim_compute_robot_state-npc2": 0.06098607063293457, "sim_compute_robot_state-npc3": 0.06263363679250081}, "udem1-3-0": {"driven_any": 0.024158897917015212, "sim_physics": 0.07031399726867676, "survival_time": 14.950000000000076, "driven_lanedir": -0.0022212142730455575, "sim_render-ego": 0.06007475852966308, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.14412349303563435, "deviation-heading": 5.484319536528106, "set_robot_commands": 0.09000205437342326, "deviation-center-line": 0.40553416940715226, "driven_lanedir_consec": -0.0022212142730455575, "sim_compute_sim_state": 0.03726213932037353, "sim_compute_performance-ego": 0.0636994202931722, "sim_compute_robot_state-ego": 0.06691894133885702, "sim_compute_robot_state-npc0": 0.06472829977671306, "sim_compute_robot_state-npc1": 0.06635281642278036, "sim_compute_robot_state-npc2": 0.06584343989690145, "sim_compute_robot_state-npc3": 0.06665830930074056}, "udem1-4-0": {"driven_any": 0.027940797283155145, "sim_physics": 0.07087593078613282, "survival_time": 14.950000000000076, "driven_lanedir": 0.00030327325308765474, "sim_render-ego": 0.060943894386291504, "in-drivable-lane": 7.650000000000042, "agent_compute-ego": 0.14906886180241902, "deviation-heading": 5.766106818286449, "set_robot_commands": 0.09227288405100505, "deviation-center-line": 0.025329293139968057, "driven_lanedir_consec": 0.00030327325308765474, "sim_compute_sim_state": 0.03702423334121704, "sim_compute_performance-ego": 0.06577642838160197, "sim_compute_robot_state-ego": 0.0706913169225057, "sim_compute_robot_state-npc0": 0.06875701109568277, "sim_compute_robot_state-npc1": 0.06733001947402954, "sim_compute_robot_state-npc2": 0.06758280038833618, "sim_compute_robot_state-npc3": 0.06611668666203817}}
set_robot_commands_max	0.09246764580408733
set_robot_commands_mean	0.0908387460708618
set_robot_commands_median	0.09167600313822429
set_robot_commands_min	0.08777514298756918
sim_compute_performance-ego_max	0.0662910795211792
sim_compute_performance-ego_mean	0.06525778325398764
sim_compute_performance-ego_median	0.06577642838160197
sim_compute_performance-ego_min	0.0636994202931722
sim_compute_robot_state-ego_max	0.0706913169225057
sim_compute_robot_state-ego_mean	0.06887733538945515
sim_compute_robot_state-ego_median	0.07030797640482585
sim_compute_robot_state-ego_min	0.06612100919087728
sim_compute_robot_state-npc0_max	0.06875701109568277
sim_compute_robot_state-npc0_mean	0.06629098463058472
sim_compute_robot_state-npc0_median	0.06748725255330404
sim_compute_robot_state-npc0_min	0.06267067988713583
sim_compute_robot_state-npc1_max	0.06896541198094686
sim_compute_robot_state-npc1_mean	0.06643496545155844
sim_compute_robot_state-npc1_median	0.06733001947402954
sim_compute_robot_state-npc1_min	0.061491798559824624
sim_compute_robot_state-npc2_max	0.06758280038833618
sim_compute_robot_state-npc2_mean	0.06537271467844645
sim_compute_robot_state-npc2_median	0.06584343989690145
sim_compute_robot_state-npc2_min	0.06098607063293457
sim_compute_robot_state-npc3_max	0.06692586263020833
sim_compute_robot_state-npc3_mean	0.06583716917037964
sim_compute_robot_state-npc3_median	0.06665830930074056
sim_compute_robot_state-npc3_min	0.06263363679250081
sim_compute_sim_state_max	0.03840984265009562
sim_compute_sim_state_mean	0.037042751471201577
sim_compute_sim_state_median	0.03726213932037353
sim_compute_sim_state_min	0.03509967009226481
sim_physics_max	0.0753757643699646
sim_physics_mean	0.07234178431828817
sim_physics_median	0.07087593078613282
sim_physics_min	0.07031399726867676
sim_render-ego_max	0.06156574249267578
sim_render-ego_mean	0.06009284957249959
sim_render-ego_median	0.060943894386291504
sim_render-ego_min	0.056350150903066
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20072

2684

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 09:05:53+00:00

2019-04-25 09:26:42+00:00

0:20:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4548063607291752
survival_time_median	5.14999999999999
deviation-center-line_median	0.23944012155426544
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.08780537018409142
agent_compute-ego_mean	0.0805713734946568
agent_compute-ego_median	0.08047882477442424
agent_compute-ego_min	0.06948277788254821
deviation-center-line_max	0.9481891390408244
deviation-center-line_mean	0.4817110497361832
deviation-center-line_min	0.1978052828765215
deviation-heading_max	5.356935618799569
deviation-heading_mean	2.844518347898202
deviation-heading_median	2.062172341532157
deviation-heading_min	0.6951378663610231
driven_any_max	2.3328695250094738
driven_any_mean	1.1225622020073769
driven_any_median	0.7738194479766416
driven_any_min	0.4524417084546482
driven_lanedir_consec_max	1.182316023735656
driven_lanedir_consec_mean	0.5919347092783888
driven_lanedir_consec_min	0.3491878152904955
driven_lanedir_max	1.317232252056785
driven_lanedir_mean	0.6939367600483463
driven_lanedir_median	0.5437131180067065
driven_lanedir_min	0.3491878152904955
in-drivable-lane_max	4.200000000000039
in-drivable-lane_mean	1.60000000000001
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.3328695250094738, "sim_physics": 0.2235527459780375, "survival_time": 14.950000000000076, "driven_lanedir": 1.317232252056785, "sim_render-ego": 0.0653648821512858, "in-drivable-lane": 4.200000000000039, "agent_compute-ego": 0.08047882477442424, "deviation-heading": 5.356935618799569, "set_robot_commands": 0.1031094495455424, "deviation-center-line": 0.9481891390408244, "driven_lanedir_consec": 1.182316023735656, "sim_compute_sim_state": 0.04118432998657227, "sim_compute_performance-ego": 0.07334381182988485, "sim_compute_robot_state-ego": 0.0783687980969747, "sim_compute_robot_state-npc0": 0.0723645806312561, "sim_compute_robot_state-npc1": 0.07250318924585979, "sim_compute_robot_state-npc2": 0.0711239226659139, "sim_compute_robot_state-npc3": 0.0709940242767334}, "udem1-1-0": {"driven_any": 0.7738194479766416, "sim_physics": 0.15855785480980733, "survival_time": 5.14999999999999, "driven_lanedir": 0.5437131180067065, "sim_render-ego": 0.0553462019244444, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06948277788254821, "deviation-heading": 2.062172341532157, "set_robot_commands": 0.08260100096174815, "deviation-center-line": 0.23064348036475976, "driven_lanedir_consec": 0.5437131180067065, "sim_compute_sim_state": 0.03555008045678, "sim_compute_performance-ego": 0.06062644430734579, "sim_compute_robot_state-ego": 0.06104013063375232, "sim_compute_robot_state-npc0": 0.06240100073582918, "sim_compute_robot_state-npc1": 0.060249960538253045, "sim_compute_robot_state-npc2": 0.0601650812093494, "sim_compute_robot_state-npc3": 0.05999686417070407}, "udem1-2-0": {"driven_any": 1.585100529844096, "sim_physics": 0.20901337090660543, "survival_time": 10.20000000000001, "driven_lanedir": 0.8047442541585696, "sim_render-ego": 0.06709121839672912, "in-drivable-lane": 2.9500000000000135, "agent_compute-ego": 0.08034787458531997, "deviation-heading": 4.469405077765205, "set_robot_commands": 0.1037151907004562, "deviation-center-line": 0.7924772248445449, "driven_lanedir_consec": 0.4296502286299111, "sim_compute_sim_state": 0.040908566876953725, "sim_compute_performance-ego": 0.07124291564904008, "sim_compute_robot_state-ego": 0.07643761588077919, "sim_compute_robot_state-npc0": 0.07487531386169732, "sim_compute_robot_state-npc1": 0.07400760697383507, "sim_compute_robot_state-npc2": 0.07265621189977609, "sim_compute_robot_state-npc3": 0.07306697672488642}, "udem1-3-0": {"driven_any": 0.4524417084546482, "sim_physics": 0.2084733039613754, "survival_time": 3.149999999999997, "driven_lanedir": 0.3491878152904955, "sim_render-ego": 0.06538545517694383, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.0847420200469002, "deviation-heading": 1.6389408350330563, "set_robot_commands": 0.10202144441150485, "deviation-center-line": 0.1978052828765215, "driven_lanedir_consec": 0.3491878152904955, "sim_compute_sim_state": 0.042752568683927024, "sim_compute_performance-ego": 0.07253186286441864, "sim_compute_robot_state-ego": 0.08152870147947282, "sim_compute_robot_state-npc0": 0.06754234858921596, "sim_compute_robot_state-npc1": 0.0685924007779076, "sim_compute_robot_state-npc2": 0.06922389968993171, "sim_compute_robot_state-npc3": 0.07245550836835589}, "udem1-4-0": {"driven_any": 0.468579798752024, "sim_physics": 0.18488825651315544, "survival_time": 3.2499999999999964, "driven_lanedir": 0.4548063607291752, "sim_render-ego": 0.07545412870553823, "in-drivable-lane": 0, "agent_compute-ego": 0.08780537018409142, "deviation-heading": 0.6951378663610231, "set_robot_commands": 0.10887431731590858, "deviation-center-line": 0.23944012155426544, "driven_lanedir_consec": 0.4548063607291752, "sim_compute_sim_state": 0.048374249384953424, "sim_compute_performance-ego": 0.07542082346402681, "sim_compute_robot_state-ego": 0.08147033544687124, "sim_compute_robot_state-npc0": 0.07743755854093111, "sim_compute_robot_state-npc1": 0.07727161554189829, "sim_compute_robot_state-npc2": 0.0779113402733436, "sim_compute_robot_state-npc3": 0.0785195203927847}}
set_robot_commands_max	0.10887431731590858
set_robot_commands_mean	0.10006428058703204
set_robot_commands_median	0.1031094495455424
set_robot_commands_min	0.08260100096174815
sim_compute_performance-ego_max	0.07542082346402681
sim_compute_performance-ego_mean	0.07063317162294322
sim_compute_performance-ego_median	0.07253186286441864
sim_compute_performance-ego_min	0.06062644430734579
sim_compute_robot_state-ego_max	0.08152870147947282
sim_compute_robot_state-ego_mean	0.07576911630757006
sim_compute_robot_state-ego_median	0.0783687980969747
sim_compute_robot_state-ego_min	0.06104013063375232
sim_compute_robot_state-npc0_max	0.07743755854093111
sim_compute_robot_state-npc0_mean	0.07092416047178593
sim_compute_robot_state-npc0_median	0.0723645806312561
sim_compute_robot_state-npc0_min	0.06240100073582918
sim_compute_robot_state-npc1_max	0.07727161554189829
sim_compute_robot_state-npc1_mean	0.07052495461555078
sim_compute_robot_state-npc1_median	0.07250318924585979
sim_compute_robot_state-npc1_min	0.060249960538253045
sim_compute_robot_state-npc2_max	0.0779113402733436
sim_compute_robot_state-npc2_mean	0.07021609114766295
sim_compute_robot_state-npc2_median	0.0711239226659139
sim_compute_robot_state-npc2_min	0.0601650812093494
sim_compute_robot_state-npc3_max	0.0785195203927847
sim_compute_robot_state-npc3_mean	0.07100657878669289
sim_compute_robot_state-npc3_median	0.07245550836835589
sim_compute_robot_state-npc3_min	0.05999686417070407
sim_compute_sim_state_max	0.048374249384953424
sim_compute_sim_state_mean	0.041753959077837285
sim_compute_sim_state_median	0.04118432998657227
sim_compute_sim_state_min	0.03555008045678
sim_physics_max	0.2235527459780375
sim_physics_mean	0.19689710643379624
sim_physics_median	0.2084733039613754
sim_physics_min	0.15855785480980733
sim_render-ego_max	0.07545412870553823
sim_render-ego_mean	0.06572837727098828
sim_render-ego_median	0.06538545517694383
sim_render-ego_min	0.0553462019244444
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.340000000000015
survival_time_min	3.149999999999997

No reset possible

20068

2738

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-25 09:03:57+00:00

2019-04-25 09:05:45+00:00

0:01:48

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20054

3050

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:00:39+00:00

2019-04-25 09:03:37+00:00

0:02:58

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20046

2660

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 08:59:27+00:00

2019-04-25 09:00:32+00:00

0:01:05

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20046-864732', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20046-864732', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20046-864732', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20034

2363

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 08:49:52+00:00

2019-04-25 08:50:48+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20028

2370

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

error

2019-04-25 08:48:52+00:00

2019-04-25 08:49:46+00:00

0:00:54

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20022

2386

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:46:50+00:00

2019-04-25 08:48:14+00:00

0:01:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19980

2506

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 08:42:44+00:00

2019-04-25 08:46:01+00:00

0:03:17

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19963

2609

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:41:08+00:00

2019-04-25 08:42:04+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19946

2767

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:39:54+00:00

2019-04-25 08:40:50+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19921

2957

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-25 08:38:08+00:00

2019-04-25 08:39:41+00:00

0:01:33

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19911

2669

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

2019-04-25 08:37:12+00:00

2019-04-25 08:37:43+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19895

2759

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:35:57+00:00

2019-04-25 08:36:52+00:00

0:00:55

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19881

2857

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:34:42+00:00

2019-04-25 08:35:35+00:00

0:00:53

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19868

2949

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:33:11+00:00

2019-04-25 08:34:25+00:00

0:01:14

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19842

3047

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 08:29:32+00:00

2019-04-25 08:32:43+00:00

0:03:11

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19837

2581

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:27:00+00:00

2019-04-25 08:29:25+00:00

0:02:25

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19782

2964

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 08:00:20+00:00

2019-04-25 08:26:47+00:00

0:26:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5975986756994165
survival_time_median	14.250000000000068
deviation-center-line_median	0.3775052436346698
in-drivable-lane_median	1.7499999999999938

other stats

agent_compute-ego_max	0.23841966662490577
agent_compute-ego_mean	0.2111329305013573
agent_compute-ego_median	0.2196654665390117
agent_compute-ego_min	0.1742461057419473
deviation-center-line_max	1.1025796926994342
deviation-center-line_mean	0.520206485180279
deviation-center-line_min	0.18960642709523456
deviation-heading_max	4.212639230003372
deviation-heading_mean	2.148380848089503
deviation-heading_median	1.7489013413312102
deviation-heading_min	1.3062353559265814
driven_any_max	2.070954882041485
driven_any_mean	1.4088388339405131
driven_any_median	1.56214733690226
driven_any_min	0.6352242709825823
driven_lanedir_consec_max	1.5485624462583454
driven_lanedir_consec_mean	0.7867777219961404
driven_lanedir_consec_min	0.3002145230499671
driven_lanedir_max	1.5485624462583454
driven_lanedir_mean	0.792496370339663
driven_lanedir_median	0.6141268241945652
driven_lanedir_min	0.3071272359464803
in-drivable-lane_max	11.750000000000082
in-drivable-lane_mean	3.5200000000000173
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.7427730549662384, "sim_physics": 0.04702743647391336, "survival_time": 14.250000000000068, "driven_lanedir": 1.181602827372633, "sim_render-ego": 0.06530402836046721, "in-drivable-lane": 2.800000000000015, "agent_compute-ego": 0.23841966662490577, "deviation-heading": 4.212639230003372, "set_robot_commands": 0.10280426761560273, "deviation-center-line": 1.1025796926994342, "driven_lanedir_consec": 1.1764504470466817, "sim_compute_sim_state": 0.041213796849836386, "sim_compute_performance-ego": 0.07073174777783846, "sim_compute_robot_state-ego": 0.07440176093787478, "sim_compute_robot_state-npc0": 0.07184883251524808, "sim_compute_robot_state-npc1": 0.07212376761854741, "sim_compute_robot_state-npc2": 0.07257826035482842, "sim_compute_robot_state-npc3": 0.07244790144133986}, "udem1-1-0": {"driven_any": 1.03309462481, "sim_physics": 0.0459586581927818, "survival_time": 7.449999999999981, "driven_lanedir": 0.6141268241945652, "sim_render-ego": 0.06224137824653779, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.2196654665390117, "deviation-heading": 1.7489013413312102, "set_robot_commands": 0.09563238828774266, "deviation-center-line": 0.3775052436346698, "driven_lanedir_consec": 0.5975986756994165, "sim_compute_sim_state": 0.03923299488605269, "sim_compute_performance-ego": 0.06772008038207189, "sim_compute_robot_state-ego": 0.06991136474097336, "sim_compute_robot_state-npc0": 0.06745400844804393, "sim_compute_robot_state-npc1": 0.07026319215761735, "sim_compute_robot_state-npc2": 0.06907923269591876, "sim_compute_robot_state-npc3": 0.06877626188649427}, "udem1-2-0": {"driven_any": 2.070954882041485, "sim_physics": 0.041172974904378254, "survival_time": 14.950000000000076, "driven_lanedir": 0.3110625179262909, "sim_render-ego": 0.05923715114593506, "in-drivable-lane": 11.750000000000082, "agent_compute-ego": 0.22008292516072592, "deviation-heading": 1.3062353559265814, "set_robot_commands": 0.0903991667429606, "deviation-center-line": 0.18960642709523456, "driven_lanedir_consec": 0.3110625179262909, "sim_compute_sim_state": 0.03705477873484293, "sim_compute_performance-ego": 0.06478403170903524, "sim_compute_robot_state-ego": 0.06987037817637126, "sim_compute_robot_state-npc0": 0.06497082948684692, "sim_compute_robot_state-npc1": 0.06518334865570069, "sim_compute_robot_state-npc2": 0.06604402144749959, "sim_compute_robot_state-npc3": 0.06565812508265177}, "udem1-3-0": {"driven_any": 0.6352242709825823, "sim_physics": 0.039727117152924235, "survival_time": 4.699999999999991, "driven_lanedir": 0.3071272359464803, "sim_render-ego": 0.05341643221834873, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.1742461057419473, "deviation-heading": 1.790602410550626, "set_robot_commands": 0.07954592907682378, "deviation-center-line": 0.21761450356562737, "driven_lanedir_consec": 0.3002145230499671, "sim_compute_sim_state": 0.032087977896345425, "sim_compute_performance-ego": 0.055417821762409614, "sim_compute_robot_state-ego": 0.058138809305556274, "sim_compute_robot_state-npc0": 0.05637708116084971, "sim_compute_robot_state-npc1": 0.05513867672453535, "sim_compute_robot_state-npc2": 0.05324838009286434, "sim_compute_robot_state-npc3": 0.05643840799940393}, "udem1-4-0": {"driven_any": 1.56214733690226, "sim_physics": 0.03877755403518677, "survival_time": 14.950000000000076, "driven_lanedir": 1.5485624462583454, "sim_render-ego": 0.05687099933624268, "in-drivable-lane": 0, "agent_compute-ego": 0.20325048844019572, "deviation-heading": 1.6835259026357234, "set_robot_commands": 0.0880026388168335, "deviation-center-line": 0.7137265589064293, "driven_lanedir_consec": 1.5485624462583454, "sim_compute_sim_state": 0.0355991538365682, "sim_compute_performance-ego": 0.06210660378138224, "sim_compute_robot_state-ego": 0.06547492186228435, "sim_compute_robot_state-npc0": 0.06297893206278483, "sim_compute_robot_state-npc1": 0.06289551417032878, "sim_compute_robot_state-npc2": 0.06137293418248495, "sim_compute_robot_state-npc3": 0.06175297498703003}}
set_robot_commands_max	0.10280426761560273
set_robot_commands_mean	0.09127687810799266
set_robot_commands_median	0.0903991667429606
set_robot_commands_min	0.07954592907682378
sim_compute_performance-ego_max	0.07073174777783846
sim_compute_performance-ego_mean	0.06415205708254748
sim_compute_performance-ego_median	0.06478403170903524
sim_compute_performance-ego_min	0.055417821762409614
sim_compute_robot_state-ego_max	0.07440176093787478
sim_compute_robot_state-ego_mean	0.067559447004612
sim_compute_robot_state-ego_median	0.06987037817637126
sim_compute_robot_state-ego_min	0.058138809305556274
sim_compute_robot_state-npc0_max	0.07184883251524808
sim_compute_robot_state-npc0_mean	0.0647259367347547
sim_compute_robot_state-npc0_median	0.06497082948684692
sim_compute_robot_state-npc0_min	0.05637708116084971
sim_compute_robot_state-npc1_max	0.07212376761854741
sim_compute_robot_state-npc1_mean	0.06512089986534593
sim_compute_robot_state-npc1_median	0.06518334865570069
sim_compute_robot_state-npc1_min	0.05513867672453535
sim_compute_robot_state-npc2_max	0.07257826035482842
sim_compute_robot_state-npc2_mean	0.0644645657547192
sim_compute_robot_state-npc2_median	0.06604402144749959
sim_compute_robot_state-npc2_min	0.05324838009286434
sim_compute_robot_state-npc3_max	0.07244790144133986
sim_compute_robot_state-npc3_mean	0.06501473427938396
sim_compute_robot_state-npc3_median	0.06565812508265177
sim_compute_robot_state-npc3_min	0.05643840799940393
sim_compute_sim_state_max	0.041213796849836386
sim_compute_sim_state_mean	0.037037740440729126
sim_compute_sim_state_median	0.03705477873484293
sim_compute_sim_state_min	0.032087977896345425
sim_physics_max	0.04702743647391336
sim_physics_mean	0.042532748151836886
sim_physics_median	0.041172974904378254
sim_physics_min	0.03877755403518677
sim_render-ego_max	0.06530402836046721
sim_render-ego_mean	0.05941399786150629
sim_render-ego_median	0.05923715114593506
sim_render-ego_min	0.05341643221834873
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.26000000000004
survival_time_min	4.699999999999991

No reset possible

19762

2762

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-25 07:52:01+00:00

2019-04-25 08:00:05+00:00

0:08:04

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19762-74667', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19762-74667', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19762-74667', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19748

2851

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 07:45:33+00:00

2019-04-25 07:51:18+00:00

0:05:45

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19737

3035

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-24 21:09:49+00:00

2019-04-24 21:11:09+00:00

0:01:20

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19717

3030

challenge-aido_LF-template-pytorch

step1-simulation

error