A quadratic form is a polynomial of only degree 2 terms. For example, .

Quadratic Form for Matrices

For a square matrix and variable , the quadratic form is

Its derivative is

We can derive this derivative by using product rule