yuriw-2019-01-22_21:02:17-multimds-luminous-distro-basic-smithi

3493153

FAIL

luminous

luminous

master

smithi

 

smithi063 smithi077 smithi148

multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml}

reached maximum tries (150) after waiting for 900 seconds

3493164

FAIL

luminous

luminous

master

smithi

centos 

smithi038 smithi043 smithi074

multimds/verify/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml}

reached maximum tries (50) after waiting for 300 seconds

3493165

FAIL

luminous

luminous

master

smithi

 

smithi027 smithi041 smithi196

multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml}

"2019-01-25 00:41:20.771062 mon.b mon.0 172.21.15.27:6789/0 236 : cluster [WRN] Health check failed: 516 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log

3493167

FAIL

luminous

luminous

master

smithi

 

smithi060 smithi181 smithi192

multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml}

[Errno 28] No space left on device: '/tmp/tmpS0jerf'

3493170

FAIL

luminous

luminous

master

smithi

 

smithi001 smithi158 smithi182

multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml}

{'smithi001.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 130, in run\n res = self._execute()\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 528, in _execute\n result = self._handler.run(task_vars=variables)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/ansible/plugins/action/template.py", line 181, in run\n shutil.rmtree(tempdir)\nUnboundLocalError: local variable \'tempdir\' referenced before assignment\n', 'stdout': ''}}

3493171

FAIL

luminous

luminous

master

smithi

centos 

smithi072 smithi136 smithi189

multimds/verify/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml}

3493172

FAIL

luminous

luminous

master

smithi

 

smithi082 smithi131 smithi176

multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml}

"2019-01-23 15:55:30.204371 mon.a mon.0 172.21.15.82:6789/0 172 : cluster [WRN] Health check failed: 9687 slow requests are blocked > 32 sec. Implicated osds 0,2,4,5,6 (REQUEST_SLOW)" in cluster log

3493173

FAIL

luminous

luminous

master

smithi

 

smithi093 smithi121 smithi176

multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml}

{'smithi121.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 130, in run\n res = self._execute()\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 528, in _execute\n result = self._handler.run(task_vars=variables)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/ansible/plugins/action/template.py", line 181, in run\n shutil.rmtree(tempdir)\nUnboundLocalError: local variable \'tempdir\' referenced before assignment\n', 'stdout': ''}}

3493179

FAIL

luminous

luminous

master

smithi

 

smithi031 smithi159 smithi184

multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml}

"2019-01-25 00:43:56.056677 mon.b mon.0 172.21.15.31:6789/0 146 : cluster [WRN] Health check failed: 528 slow requests are blocked > 32 sec. Implicated osds 6 (REQUEST_SLOW)" in cluster log

3493185

FAIL

luminous

luminous

master

smithi

centos 

smithi093 smithi121 smithi192

multimds/verify/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml}

"2019-01-25 02:31:07.643755 mon.a mon.0 172.21.15.121:6789/0 624 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log

3493186

FAIL

luminous

luminous

master

smithi

 

smithi115 smithi159 smithi184

multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml}

"2019-01-25 01:45:57.984022 mon.b mon.0 172.21.15.115:6789/0 144 : cluster [WRN] Health check failed: 55 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log

3493193

FAIL

luminous

luminous

master

smithi

 

smithi042 smithi134 smithi194

multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml}

"2019-01-25 00:45:19.388824 mon.b mon.0 172.21.15.134:6789/0 148 : cluster [WRN] Health check failed: 12 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log

3493199

FAIL

luminous

luminous

master

smithi

centos 

smithi091 smithi137 smithi201

multimds/verify/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml}

reached maximum tries (50) after waiting for 300 seconds