Evaluator 1068

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

22089

3433

FANG MEIYI 🇸🇬

test

aido2-LFVI-sim-testing

step1-simulation

host-error

ip-172-31-42-167-7227

2019-05-14 10:54:15+00:00

2019-05-14 11:01:52+00:00

0:07:37

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22089-687555', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22089-687555', 'down']:

   >  Command '['docker-compose', '-p', 'job22089-687555', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22077

3428

jiang peng

RL-TH-shi

aido2-LFVI-sim-validation

step1-simulation

success

ip-172-31-42-167-7227

2019-05-14 09:01:41+00:00

2019-05-14 09:28:25+00:00

0:26:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.8931654547277805
survival_time_median	14.950000000000076
deviation-center-line_median	0.7563997434988093
in-drivable-lane_median	0.04999999999999982

other stats

agent_compute-ego_max	0.16659615914026896
agent_compute-ego_mean	0.14550105771970984
agent_compute-ego_median	0.15837650934855144
agent_compute-ego_min	0.1033315364519755
deviation-center-line_max	0.992235461074024
deviation-center-line_mean	0.7304777995404858
deviation-center-line_min	0.35299527458571317
deviation-heading_max	3.691031048169515
deviation-heading_mean	3.0738527484731746
deviation-heading_median	3.602022990805161
deviation-heading_min	1.0783114132347906
driven_any_max	3.836832240333083
driven_any_mean	2.759871282774769
driven_any_median	3.209565573320463
driven_any_min	0.5240803896808672
driven_lanedir_consec_max	3.1482142900552015
driven_lanedir_consec_mean	2.378526511211859
driven_lanedir_consec_min	0.4866452661274496
driven_lanedir_max	3.727504247616812
driven_lanedir_mean	2.627023798519424
driven_lanedir_median	3.1457571453545254
driven_lanedir_min	0.4866452661274496
in-drivable-lane_max	0.8500000000000121
in-drivable-lane_mean	0.2900000000000039
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 3.013097547610835, "sim_physics": 0.189412891070048, "survival_time": 14.950000000000076, "driven_lanedir": 2.626711561186126, "sim_render-ego": 0.06036502122879028, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.16449094613393148, "deviation-heading": 3.602022990805161, "set_robot_commands": 0.08953360319137574, "deviation-center-line": 0.7563997434988093, "driven_lanedir_consec": 2.366991956914994, "sim_compute_sim_state": 0.037759960492451984, "sim_compute_performance-ego": 0.06655502875645955, "sim_compute_robot_state-ego": 0.07091822067896525, "sim_compute_robot_state-npc0": 0.06507369518280029, "sim_compute_robot_state-npc1": 0.06504610935846965, "sim_compute_robot_state-npc2": 0.06520967245101929, "sim_compute_robot_state-npc3": 0.06553863604863484}, "udem1-1-0": {"driven_any": 3.2157806629285974, "sim_physics": 0.1838849981625875, "survival_time": 14.950000000000076, "driven_lanedir": 3.148500772312209, "sim_render-ego": 0.05799984773000082, "in-drivable-lane": 0, "agent_compute-ego": 0.16659615914026896, "deviation-heading": 3.3246483649265195, "set_robot_commands": 0.08797481775283814, "deviation-center-line": 0.686968798359912, "driven_lanedir_consec": 3.1482142900552015, "sim_compute_sim_state": 0.0369502329826355, "sim_compute_performance-ego": 0.06464512348175049, "sim_compute_robot_state-ego": 0.07006938775380453, "sim_compute_robot_state-npc0": 0.06709941546122233, "sim_compute_robot_state-npc1": 0.06529622475306193, "sim_compute_robot_state-npc2": 0.06846625725428264, "sim_compute_robot_state-npc3": 0.0660980494817098}, "udem1-2-0": {"driven_any": 3.836832240333083, "sim_physics": 0.1745801568031311, "survival_time": 14.950000000000076, "driven_lanedir": 3.727504247616812, "sim_render-ego": 0.05494661092758179, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.15837650934855144, "deviation-heading": 3.673249925229886, "set_robot_commands": 0.08475986083348593, "deviation-center-line": 0.8637897201839704, "driven_lanedir_consec": 2.9976155882338698, "sim_compute_sim_state": 0.0342171851793925, "sim_compute_performance-ego": 0.05959437370300293, "sim_compute_robot_state-ego": 0.06468491713205973, "sim_compute_robot_state-npc0": 0.06248038291931152, "sim_compute_robot_state-npc1": 0.06316960732142131, "sim_compute_robot_state-npc2": 0.06218795776367188, "sim_compute_robot_state-npc3": 0.0613292129834493}, "udem1-3-0": {"driven_any": 0.5240803896808672, "sim_physics": 0.13572541279579275, "survival_time": 3.349999999999996, "driven_lanedir": 0.4866452661274496, "sim_render-ego": 0.048211877025775056, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.13471013752382194, "deviation-heading": 1.0783114132347906, "set_robot_commands": 0.06834313051024479, "deviation-center-line": 0.35299527458571317, "driven_lanedir_consec": 0.4866452661274496, "sim_compute_sim_state": 0.02799296734937981, "sim_compute_performance-ego": 0.046046242785097946, "sim_compute_robot_state-ego": 0.04826359606500882, "sim_compute_robot_state-npc0": 0.04842607298893715, "sim_compute_robot_state-npc1": 0.04864850684778014, "sim_compute_robot_state-npc2": 0.04942830285029625, "sim_compute_robot_state-npc3": 0.04899705701799535}, "udem1-4-0": {"driven_any": 3.209565573320463, "sim_physics": 0.10231894810994466, "survival_time": 14.950000000000076, "driven_lanedir": 3.1457571453545254, "sim_render-ego": 0.036535479227701825, "in-drivable-lane": 0, "agent_compute-ego": 0.1033315364519755, "deviation-heading": 3.691031048169515, "set_robot_commands": 0.05611123641331991, "deviation-center-line": 0.992235461074024, "driven_lanedir_consec": 2.8931654547277805, "sim_compute_sim_state": 0.022650369008382163, "sim_compute_performance-ego": 0.039018611113230385, "sim_compute_robot_state-ego": 0.04134516795476278, "sim_compute_robot_state-npc0": 0.04116516351699829, "sim_compute_robot_state-npc1": 0.04027079264322917, "sim_compute_robot_state-npc2": 0.040016462008158366, "sim_compute_robot_state-npc3": 0.04063411792119344}}
set_robot_commands_max	0.08953360319137574
set_robot_commands_mean	0.07734452974025288
set_robot_commands_median	0.08475986083348593
set_robot_commands_min	0.05611123641331991
sim_compute_performance-ego_max	0.06655502875645955
sim_compute_performance-ego_mean	0.055171875967908256
sim_compute_performance-ego_median	0.05959437370300293
sim_compute_performance-ego_min	0.039018611113230385
sim_compute_robot_state-ego_max	0.07091822067896525
sim_compute_robot_state-ego_mean	0.05905625791692022
sim_compute_robot_state-ego_median	0.06468491713205973
sim_compute_robot_state-ego_min	0.04134516795476278
sim_compute_robot_state-npc0_max	0.06709941546122233
sim_compute_robot_state-npc0_mean	0.056848946013853915
sim_compute_robot_state-npc0_median	0.06248038291931152
sim_compute_robot_state-npc0_min	0.04116516351699829
sim_compute_robot_state-npc1_max	0.06529622475306193
sim_compute_robot_state-npc1_mean	0.056486248184792434
sim_compute_robot_state-npc1_median	0.06316960732142131
sim_compute_robot_state-npc1_min	0.04027079264322917
sim_compute_robot_state-npc2_max	0.06846625725428264
sim_compute_robot_state-npc2_mean	0.05706173046548568
sim_compute_robot_state-npc2_median	0.06218795776367188
sim_compute_robot_state-npc2_min	0.040016462008158366
sim_compute_robot_state-npc3_max	0.0660980494817098
sim_compute_robot_state-npc3_mean	0.056519414690596535
sim_compute_robot_state-npc3_median	0.0613292129834493
sim_compute_robot_state-npc3_min	0.04063411792119344
sim_compute_sim_state_max	0.037759960492451984
sim_compute_sim_state_mean	0.03191414300244839
sim_compute_sim_state_median	0.0342171851793925
sim_compute_sim_state_min	0.022650369008382163
sim_physics_max	0.189412891070048
sim_physics_mean	0.15718448138830082
sim_physics_median	0.1745801568031311
sim_physics_min	0.10231894810994466
sim_render-ego_max	0.06036502122879028
sim_render-ego_mean	0.05161176722796995
sim_render-ego_median	0.05494661092758179
sim_render-ego_min	0.036535479227701825
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.63000000000006
survival_time_min	3.349999999999996

No reset possible

22073

3424

jiang peng

RL-TH-shi

aido2-LFV-sim-validation

step1-simulation

host-error

ip-172-31-42-167-7227

2019-05-14 08:44:48+00:00

2019-05-14 09:01:13+00:00

0:16:25

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22073-93136', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22073-93136', 'down']:

   >  Command '['docker-compose', '-p', 'job22073-93136', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22067

3418

jiang peng

RL-TH-shi

aido2-LFV-sim-validation

step1-simulation

success

ip-172-31-42-167-7227

2019-05-14 08:16:08+00:00

2019-05-14 08:36:02+00:00

0:19:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.471763509160977
survival_time_median	14.950000000000076
deviation-center-line_median	0.41556316248057446
in-drivable-lane_median	3.900000000000028

other stats

agent_compute-ego_max	0.1317703660329183
agent_compute-ego_mean	0.10812136468467472
agent_compute-ego_median	0.09823599020640056
agent_compute-ego_min	0.09671831766764324
deviation-center-line_max	0.8720874378863743
deviation-center-line_mean	0.474754378151662
deviation-center-line_min	0.23581559595653467
deviation-heading_max	4.321183603046964
deviation-heading_mean	2.5476436370574076
deviation-heading_median	1.9210947749938176
deviation-heading_min	0.6757179062246845
driven_any_max	3.747238646741675
driven_any_mean	2.482616340340404
driven_any_median	2.273122183492182
driven_any_min	1.3247723292100115
driven_lanedir_consec_max	3.7071112660818706
driven_lanedir_consec_mean	1.8658098536598469
driven_lanedir_consec_min	1.2821107501650395
driven_lanedir_max	3.7071112660818706
driven_lanedir_mean	2.222623869328171
driven_lanedir_median	1.6613710654779017
driven_lanedir_min	1.2821107501650395
in-drivable-lane_max	11.150000000000084
in-drivable-lane_mean	4.2900000000000205
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0322198564045495, "sim_physics": 0.08803977012634277, "survival_time": 12.500000000000044, "driven_lanedir": 1.6613710654779017, "sim_render-ego": 0.035647334098815917, "in-drivable-lane": 3.900000000000028, "agent_compute-ego": 0.09803916835784912, "deviation-heading": 4.023770911592848, "set_robot_commands": 0.054714491844177246, "deviation-center-line": 0.41556316248057446, "driven_lanedir_consec": 1.471763509160977, "sim_compute_sim_state": 0.022683792114257813, "sim_compute_performance-ego": 0.03858412075042725, "sim_compute_robot_state-ego": 0.04043949699401855, "sim_compute_robot_state-npc0": 0.04000554084777832, "sim_compute_robot_state-npc1": 0.03939946460723877, "sim_compute_robot_state-npc2": 0.039458699226379394, "sim_compute_robot_state-npc3": 0.03932474231719971}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.747238646741675, "sim_physics": 0.0968440310160319, "survival_time": 14.950000000000076, "driven_lanedir": 3.7071112660818706, "sim_render-ego": 0.03565733432769776, "in-drivable-lane": 0, "agent_compute-ego": 0.09823599020640056, "deviation-heading": 1.9210947749938176, "set_robot_commands": 0.055398337841033936, "deviation-center-line": 0.8720874378863743, "driven_lanedir_consec": 3.7071112660818706, "sim_compute_sim_state": 0.022564388116200765, "sim_compute_performance-ego": 0.038509528636932376, "sim_compute_robot_state-ego": 0.040478482246398925, "sim_compute_robot_state-npc0": 0.04001969416936239, "sim_compute_robot_state-npc1": 0.03936742703119914, "sim_compute_robot_state-npc2": 0.03929011901219686, "sim_compute_robot_state-npc3": 0.03929557243982951}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3247723292100115, "sim_physics": 0.08468153715133667, "survival_time": 14.950000000000076, "driven_lanedir": 1.2821107501650395, "sim_render-ego": 0.03499569257100423, "in-drivable-lane": 11.150000000000084, "agent_compute-ego": 0.09671831766764324, "deviation-heading": 0.6757179062246845, "set_robot_commands": 0.05433228413263957, "deviation-center-line": 0.23581559595653467, "driven_lanedir_consec": 1.2821107501650395, "sim_compute_sim_state": 0.022290070056915284, "sim_compute_performance-ego": 0.03820327679316203, "sim_compute_robot_state-ego": 0.04022953907648722, "sim_compute_robot_state-npc0": 0.03990427811940511, "sim_compute_robot_state-npc1": 0.039243590037027994, "sim_compute_robot_state-npc2": 0.0407168976465861, "sim_compute_robot_state-npc3": 0.03914812723795573}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.273122183492182, "sim_physics": 0.10812374330916497, "survival_time": 10.600000000000016, "driven_lanedir": 1.5814657385613409, "sim_render-ego": 0.040724455185656275, "in-drivable-lane": 4.9999999999999964, "agent_compute-ego": 0.11584298115856242, "deviation-heading": 1.7964509894287233, "set_robot_commands": 0.06294169965780007, "deviation-center-line": 0.30418883011228065, "driven_lanedir_consec": 1.5814657385613409, "sim_compute_sim_state": 0.02574836420563032, "sim_compute_performance-ego": 0.04457832057521029, "sim_compute_robot_state-ego": 0.04660814325764494, "sim_compute_robot_state-npc0": 0.045720614352316225, "sim_compute_robot_state-npc1": 0.04538482877443421, "sim_compute_robot_state-npc2": 0.046459916627632, "sim_compute_robot_state-npc3": 0.045075816928215745}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0357286858536012, "sim_physics": 0.11655206044514974, "survival_time": 14.950000000000076, "driven_lanedir": 2.8810605263547022, "sim_render-ego": 0.04871856768925985, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.1317703660329183, "deviation-heading": 4.321183603046964, "set_robot_commands": 0.07083141406377157, "deviation-center-line": 0.5461168643225458, "driven_lanedir_consec": 1.2865980043300067, "sim_compute_sim_state": 0.02956013600031535, "sim_compute_performance-ego": 0.051298638979593914, "sim_compute_robot_state-ego": 0.05196133454640706, "sim_compute_robot_state-npc0": 0.05265595038731893, "sim_compute_robot_state-npc1": 0.051190487543741864, "sim_compute_robot_state-npc2": 0.05142956097920736, "sim_compute_robot_state-npc3": 0.05353388706843058}}
set_robot_commands_max	0.07083141406377157
set_robot_commands_mean	0.05964364550788448
set_robot_commands_median	0.055398337841033936
set_robot_commands_min	0.05433228413263957
sim_compute_performance-ego_max	0.051298638979593914
sim_compute_performance-ego_mean	0.042234777147065174
sim_compute_performance-ego_median	0.03858412075042725
sim_compute_performance-ego_min	0.03820327679316203
sim_compute_robot_state-ego_max	0.05196133454640706
sim_compute_robot_state-ego_mean	0.04394339922419134
sim_compute_robot_state-ego_median	0.040478482246398925
sim_compute_robot_state-ego_min	0.04022953907648722
sim_compute_robot_state-npc0_max	0.05265595038731893
sim_compute_robot_state-npc0_mean	0.043661215575236195
sim_compute_robot_state-npc0_median	0.04001969416936239
sim_compute_robot_state-npc0_min	0.03990427811940511
sim_compute_robot_state-npc1_max	0.051190487543741864
sim_compute_robot_state-npc1_mean	0.0429171595987284
sim_compute_robot_state-npc1_median	0.03939946460723877
sim_compute_robot_state-npc1_min	0.039243590037027994
sim_compute_robot_state-npc2_max	0.05142956097920736
sim_compute_robot_state-npc2_mean	0.04347103869840034
sim_compute_robot_state-npc2_median	0.0407168976465861
sim_compute_robot_state-npc2_min	0.03929011901219686
sim_compute_robot_state-npc3_max	0.05353388706843058
sim_compute_robot_state-npc3_mean	0.04327562919832626
sim_compute_robot_state-npc3_median	0.03932474231719971
sim_compute_robot_state-npc3_min	0.03914812723795573
sim_compute_sim_state_max	0.02956013600031535
sim_compute_sim_state_mean	0.024569350098663907
sim_compute_sim_state_median	0.022683792114257813
sim_compute_sim_state_min	0.022290070056915284
sim_physics_max	0.11655206044514974
sim_physics_mean	0.0988482284096052
sim_physics_median	0.0968440310160319
sim_physics_min	0.08468153715133667
sim_render-ego_max	0.04871856768925985
sim_render-ego_mean	0.039148676774486815
sim_render-ego_median	0.03565733432769776
sim_render-ego_min	0.03499569257100423
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.590000000000057
survival_time_min	10.600000000000016

No reset possible

22060

3415

jiang peng

RL-TH-shi

aido2-LFV-sim-testing

step1-simulation

host-error

ip-172-31-42-167-7227

2019-05-14 07:02:14+00:00

2019-05-14 08:01:28+00:00

0:59:14

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22060-122958', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22060-122958', 'down']:

   >  Command '['docker-compose', '-p', 'job22060-122958', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22045

3382

jiang peng

RL-TH-shi

aido2-LFV-sim-testing

step1-simulation

host-error

ip-172-31-42-167-7227

2019-05-14 06:01:51+00:00

2019-05-14 07:02:06+00:00

1:00:15

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22045-232820', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22045-232820', 'down']:

   >  Command '['docker-compose', '-p', 'job22045-232820', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22038

3399

jiang peng

RL - TH -xyz

aido2-LF-sim-validation

step1-simulation

error

ip-172-31-42-167-7227

2019-05-14 05:23:11+00:00

2019-05-14 05:23:45+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22031

3398

jiang peng

RL-TH-shi

aido2-LFV-sim-validation

step1-simulation

host-error

ip-172-31-42-167-7227

2019-05-14 04:43:37+00:00

2019-05-14 05:01:54+00:00

0:18:17

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22031-71697', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22031-71697', 'down']:

   >  Command '['docker-compose', '-p', 'job22031-71697', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22019

3392

jiang peng

RL-TH-shi

aido2-LFVI-sim-validation

step1-simulation

success

ip-172-31-42-167-7227

2019-05-14 04:00:37+00:00

2019-05-14 04:32:00+00:00

0:31:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.0733475771483243
survival_time_median	14.950000000000076
deviation-center-line_median	0.9347522477301968
in-drivable-lane_median	2.950000000000042

other stats

agent_compute-ego_max	0.16412945985794067
agent_compute-ego_mean	0.14495233996709186
agent_compute-ego_median	0.14640932242075602
agent_compute-ego_min	0.12454028844833374
deviation-center-line_max	1.2419268424945211
deviation-center-line_mean	0.8759908284491857
deviation-center-line_min	0.32291085948490506
deviation-heading_max	5.435152987460212
deviation-heading_mean	3.708733221074816
deviation-heading_median	2.993986310807118
deviation-heading_min	2.2655451282877044
driven_any_max	4.297085683025536
driven_any_mean	2.761793656822777
driven_any_median	3.144762632716295
driven_any_min	0.5862568378354891
driven_lanedir_consec_max	3.870820893739886
driven_lanedir_consec_mean	2.5639954190048533
driven_lanedir_consec_min	0.5653894058759961
driven_lanedir_max	3.870820893739886
driven_lanedir_mean	2.5640218255387404
driven_lanedir_median	3.073479348719125
driven_lanedir_min	0.5653894058759961
in-drivable-lane_max	9.00000000000009
in-drivable-lane_mean	3.180000000000038
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 4.297085683025536, "sim_physics": 0.18012808561325072, "survival_time": 14.950000000000076, "driven_lanedir": 3.530558213614036, "sim_render-ego": 0.05614329099655151, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.16196630239486695, "deviation-heading": 2.993986310807118, "set_robot_commands": 0.09082244475682576, "deviation-center-line": 0.9227083943530816, "driven_lanedir_consec": 3.530558213614036, "sim_compute_sim_state": 0.03673389593760173, "sim_compute_performance-ego": 0.0629137412707011, "sim_compute_robot_state-ego": 0.06828085660934448, "sim_compute_robot_state-npc0": 0.06470428069432577, "sim_compute_robot_state-npc1": 0.06406033198038737, "sim_compute_robot_state-npc2": 0.06379826625188191, "sim_compute_robot_state-npc3": 0.06443437258402507}, "udem1-1-0": {"driven_any": 0.5862568378354891, "sim_physics": 0.18897303183873496, "survival_time": 14.950000000000076, "driven_lanedir": 0.5653894058759961, "sim_render-ego": 0.06031869411468506, "in-drivable-lane": 0, "agent_compute-ego": 0.16412945985794067, "deviation-heading": 5.435152987460212, "set_robot_commands": 0.09015020926793416, "deviation-center-line": 0.9347522477301968, "driven_lanedir_consec": 0.5653894058759961, "sim_compute_sim_state": 0.03617276271184285, "sim_compute_performance-ego": 0.06485629558563233, "sim_compute_robot_state-ego": 0.07142037073771158, "sim_compute_robot_state-npc0": 0.0647317345937093, "sim_compute_robot_state-npc1": 0.06439392964045207, "sim_compute_robot_state-npc2": 0.06382257064183552, "sim_compute_robot_state-npc3": 0.06480372031529745}, "udem1-2-0": {"driven_any": 1.7927350272789209, "sim_physics": 0.1279213293393453, "survival_time": 14.950000000000076, "driven_lanedir": 1.7798612657446589, "sim_render-ego": 0.04621559460957845, "in-drivable-lane": 9.00000000000009, "agent_compute-ego": 0.127716326713562, "deviation-heading": 2.83727457876836, "set_robot_commands": 0.07161063035329183, "deviation-center-line": 0.32291085948490506, "driven_lanedir_consec": 1.7798610046460246, "sim_compute_sim_state": 0.02858015775680542, "sim_compute_performance-ego": 0.05030380328496297, "sim_compute_robot_state-ego": 0.05211509704589844, "sim_compute_robot_state-npc0": 0.05247659206390381, "sim_compute_robot_state-npc1": 0.05282975196838379, "sim_compute_robot_state-npc2": 0.0526526673634847, "sim_compute_robot_state-npc3": 0.05211267709732056}, "udem1-3-0": {"driven_any": 3.988128103257642, "sim_physics": 0.1326937588055929, "survival_time": 14.950000000000076, "driven_lanedir": 3.870820893739886, "sim_render-ego": 0.044958404699961346, "in-drivable-lane": 3.950000000000056, "agent_compute-ego": 0.12454028844833374, "deviation-heading": 2.2655451282877044, "set_robot_commands": 0.07237922827402751, "deviation-center-line": 0.9576557981832242, "driven_lanedir_consec": 3.870820893739886, "sim_compute_sim_state": 0.0289663028717041, "sim_compute_performance-ego": 0.04875431219736735, "sim_compute_robot_state-ego": 0.05061185201009115, "sim_compute_robot_state-npc0": 0.05243231693903605, "sim_compute_robot_state-npc1": 0.05225405454635621, "sim_compute_robot_state-npc2": 0.05026259740193685, "sim_compute_robot_state-npc3": 0.05089744170506795}, "udem1-4-0": {"driven_any": 3.144762632716295, "sim_physics": 0.15840677817662557, "survival_time": 14.950000000000076, "driven_lanedir": 3.073479348719125, "sim_render-ego": 0.05074594736099243, "in-drivable-lane": 0, "agent_compute-ego": 0.14640932242075602, "deviation-heading": 5.011707100050685, "set_robot_commands": 0.0788527782758077, "deviation-center-line": 1.2419268424945211, "driven_lanedir_consec": 3.0733475771483243, "sim_compute_sim_state": 0.0322742223739624, "sim_compute_performance-ego": 0.05604012171427409, "sim_compute_robot_state-ego": 0.059918208122253416, "sim_compute_robot_state-npc0": 0.06518927812576295, "sim_compute_robot_state-npc1": 0.0577474045753479, "sim_compute_robot_state-npc2": 0.057275430361429853, "sim_compute_robot_state-npc3": 0.05718536456425985}}
set_robot_commands_max	0.09082244475682576
set_robot_commands_mean	0.08076305818557741
set_robot_commands_median	0.0788527782758077
set_robot_commands_min	0.07161063035329183
sim_compute_performance-ego_max	0.06485629558563233
sim_compute_performance-ego_mean	0.05657365481058757
sim_compute_performance-ego_median	0.05604012171427409
sim_compute_performance-ego_min	0.04875431219736735
sim_compute_robot_state-ego_max	0.07142037073771158
sim_compute_robot_state-ego_mean	0.06046927690505981
sim_compute_robot_state-ego_median	0.059918208122253416
sim_compute_robot_state-ego_min	0.05061185201009115
sim_compute_robot_state-npc0_max	0.06518927812576295
sim_compute_robot_state-npc0_mean	0.05990684048334758
sim_compute_robot_state-npc0_median	0.06470428069432577
sim_compute_robot_state-npc0_min	0.05243231693903605
sim_compute_robot_state-npc1_max	0.06439392964045207
sim_compute_robot_state-npc1_mean	0.05825709454218547
sim_compute_robot_state-npc1_median	0.0577474045753479
sim_compute_robot_state-npc1_min	0.05225405454635621
sim_compute_robot_state-npc2_max	0.06382257064183552
sim_compute_robot_state-npc2_mean	0.05756230640411377
sim_compute_robot_state-npc2_median	0.057275430361429853
sim_compute_robot_state-npc2_min	0.05026259740193685
sim_compute_robot_state-npc3_max	0.06480372031529745
sim_compute_robot_state-npc3_mean	0.05788671525319418
sim_compute_robot_state-npc3_median	0.05718536456425985
sim_compute_robot_state-npc3_min	0.05089744170506795
sim_compute_sim_state_max	0.03673389593760173
sim_compute_sim_state_mean	0.032545468330383305
sim_compute_sim_state_median	0.0322742223739624
sim_compute_sim_state_min	0.02858015775680542
sim_physics_max	0.18897303183873496
sim_physics_mean	0.1576245967547099
sim_physics_median	0.15840677817662557
sim_physics_min	0.1279213293393453
sim_render-ego_max	0.06031869411468506
sim_render-ego_mean	0.05167638635635376
sim_render-ego_median	0.05074594736099243
sim_render-ego_min	0.044958404699961346
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

22011

3387

jiang peng

RL - TH -hhk

aido2-LFV-sim-testing

step1-simulation

host-error

ip-172-31-42-167-7227

2019-05-14 03:02:40+00:00

2019-05-14 04:00:21+00:00

0:57:41

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22011-124467', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22011-124467', 'down']:

   >  Command '['docker-compose', '-p', 'job22011-124467', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22001

3383

Liam Paull 🇨🇦

duckietown lane following demo

aido2-LF-sim-testing

step1-simulation

failed

ip-172-31-42-167-7227

2019-05-14 02:43:56+00:00

2019-05-14 02:45:54+00:00

0:01:58

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

ID	1068
evaluator	`ip-172-31-42-167-7227`
owner	I don't have one 😀
machine	ip-172-31-42-167
process	ip-172-31-42-167-7227
version	d-c:4.0.29;d-c-r:4.0.40;d-s:4.0.21
first heard	2019-05-13 21:33:34+00:00
last heard	2019-05-14 13:56:41+00:00
status	inactive
# evaluating
# success	3 `22019`
# timeout
# failed	1 `22001`
# error	1 `22038`
# aborted
# host-error	6 `22011`
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator 1068

Evaluator jobs