Kernels and Support Vector Machines

In this chapter, we generalize the linear support vector machine described in Chapter 2 and Chapter 3 to nonlinear support vector machines, in which the key step is introducing kernels.

Linear support vector classification described in Chapter 2 is based on linear classification, and linear support vector regression in Chapter 3 is also derived from linear classification; therefore the first step from linear support vector machine to nonlinear support vector machine is to generalize the linear classification to nonlinear classification.