11. Cauchy–Schwarz Inequality

|𝑢𝑣|𝑢𝑣|𝑢𝑣|=𝑢𝑣when𝑢=𝑐𝑣

Where:

Step 1: Understand the dot product

The dot product of two vectors 𝑢=[𝑢1,𝑢2,,𝑢𝑛] and 𝑣=[𝑣1,𝑣2,,𝑣𝑛] is calculated as:

𝑢𝑣=𝑢1𝑣1+𝑢2𝑣2++𝑢𝑛𝑣𝑛

The magnitude (or norm) of a vector 𝑢 is:

𝑢=𝑢12+𝑢22++𝑢𝑛2

Step 2: Define a new function

We introduce a parameter 𝑡 and define a new vector:

𝑤(𝑡)=𝑢𝑡𝑣

Now, consider the dot product of this new vector with itself, which is always non-negative because it represents the square of the magnitude of 𝑤(𝑡):

𝑤(𝑡)𝑤(𝑡)0

This inequality makes sense because the dot product of any vector with itself is the square of its magnitude, and a square is always non-negative.

Step 3: Expand the dot product

Expand 𝑤(𝑡)𝑤(𝑡):

𝑤(𝑡)𝑤(𝑡)=(𝑢𝑡𝑣)(𝑢𝑡𝑣)

Now, we apply the distributive property of the dot product, which behaves similarly to the distributive property of multiplication. We expand each term:

(𝑢𝑡𝑣)(𝑢𝑡𝑣)=𝑢𝑢𝑡(𝑢𝑣)𝑡(𝑣𝑢)+𝑡2(𝑣𝑣)

Since the dot product is commutative (𝑢𝑣=𝑣𝑢), we can rewrite this as:

𝑢𝑢2𝑡(𝑢𝑣)+𝑡2(𝑣𝑣)

This simplifies to:

𝑢22𝑡(𝑢𝑣)+𝑡2𝑣2

We’ve now expressed the result of expanding the dot product as a quadratic expression in 𝑡, where

Step 4: Treat as a quadratic equation

Now that we have the quadratic expression:

𝑣2𝑡22(𝑢𝑣)𝑡+𝑢20

We recognize this as a standard quadratic inequality of the form 𝑎𝑡2+𝑏𝑡+𝑐0, where:

For any quadratic expression 𝑎𝑡2+𝑏𝑡+𝑐 to always be non-negative, its discriminant must be less than or equal to zero. The discriminant of a quadratic equation 𝑎𝑡2+𝑏𝑡+𝑐=0 is given by:

Δ=𝑏24𝑎𝑐

Substituting in the values of 𝑎, 𝑏, and 𝑐 from our expression:

Δ=(2(𝑢𝑣))24𝑣2𝑢2

Simplifying:

Δ=4(𝑢𝑣)24𝑣2𝑢2

Step 5: Apply the discriminant condition

For the quadratic inequality to hold, the discriminant must be less than or equal to zero:

Δ=4(𝑢𝑣)24𝑣2𝑢20

Divide by 4:

Δ=(𝑢𝑣)2𝑣2𝑢2

Take the square root of both sides:

|𝑢𝑣|𝑢𝑣
Example
𝑢=[12]𝑣=[34]

Step 1: Compute the dot product 𝑢𝑣

𝑢𝑣=(1)(3)+(2)(4)=3+8=11

Step 2: Compute the norms of 𝑢 and 𝑣

  • The norm 𝑢 is:
𝑢=12+22=1+4=5
  • The norm 𝑣 is:
𝑣=32+42=9+16=25=5

Step 3: Verify the Cauchy-Schwarz inequality

The inequality states:

|𝑢𝑣|𝑢𝑣

Substitute the values:

|11|55=11.18

Since 1111.18, the inequality holds.

The Cauchy-Schwarz inequality is satisfied for the vectors 𝑢=[12] and 𝑣=[34]