Choosing the kernel

• How do we choose a kernel?

• Mercer's theorem (1909): for any positive definite function there exists a corresponding mapping to a higher dimensional space

• Some of these spaces can have infinite dimensions, so a planar decision boundary can produce an arbitrarily wiggly decision boundary in the input space

Notes: