In machine learning and data mining, a string kernel is a kernel function that operates on strings, i.e. finite sequences of symbols that need not be of the same length. String kernels can be intuitively understood as functions measuring the similarity of pairs of strings: the more similar two strings a and b are, the higher the value of a string kernel K(a, b) will be. Using string kernels with kernelized learning algorithms such as support vector machines allow such algorithms to work with strings, without having to translate these to fixed-length, real-valued feature vectors. String kernels are used in domains where sequence data are to be clustered or classified, e.g. in text mining and gene analysis.
Informal introduction Suppose one wants to compare some text passages automatically and indicate their relative similarity. For many applications, it might be sufficient to find some keywords which match exactly. One example where exact matching is not always enough is found in spam detection. Another would be in computational gene analysis, where homologous genes have mutated, resulting in common subsequences along with deleted, inserted or replaced symbols.
Motivation Since several well-proven data clustering, classification and information retrieval methods (for example support vector machines) are designed to work on vectors (i.e. data are elements of a vector space), using a string kernel allows the extension of these methods to handle sequence data. The string kernel method is to be contrasted with earlier approaches for text classification where feature vectors only indicated the presence or absence of a word. Not only does it improve on these approaches, but it is an example for a whole class of kernels adapted to data structures, which began to appear at the turn of the 21st century. A survey of such methods has been compiled by Gärtner. In bioinformatics string kernels are used especially to transform biological sequences such as proteins or DNA into vectors for further use in machine learning models. An example of a string kernel used for that purpose is the profile kernel.
Definition A kernel on a domain D {\displaystyle D} is a function K : D × D → R {\displaystyle K:D\times D\rightarrow \mathbb {R} }
satisfying some conditions (being symmetric in the arguments, continuous and positive semidefinite in a certain sense). Mercer's theorem asserts that K {\displaystyle K} can then be expressed as K ( x , y ) = φ ( x ) ⋅ φ ( y ) {\displaystyle K(x,y)=\varphi (x)\cdot \varphi (y)} with φ {\displaystyle \varphi } mapping the arguments into an inner product space. We can now reproduce the definition of a string subsequence kernel on strings over an alphabet Σ {\displaystyle \Sigma } . Coordinate-wise, the mapping is defined as follows:
φ u : { Σ n → R Σ n s ↦ ∑ i : u = s i λ l ( i ) {\displaystyle \varphi _{u}:\left\{{\begin{array}{l}\Sigma ^{n}\rightarrow \mathbb {R} ^{\Sigma ^{n}}\\s\mapsto \sum _{\mathbf {i} :u=s_{\mathbf {i} }}\lambda ^{l(\mathbf {i} )}\end{array}}\right.}
… excerpt ends here. Continue reading the full article.
