Quadratic Approximation of Functions

Quadratic approximation extends linear approximation, but we also adds the third term of Taylor expansion:

Function with Multiple Variables

See: Taylor series for multi-variable functions

Given a function , we can approximate this function near by

where is the gradient evaluated at and is the Hessian matrix evaluated at .

For the specific example where has two input variables and , we can approximate near as