100. Derivatives

Measures the instantaneous rate of change of a function

Derivative of of a function 𝑓(𝑥)

𝑓(𝑥)=𝑑𝑑𝑥𝑓(𝑥)

General Pattern:

Example

Consider the quartic function: 𝑓(𝑥)=𝑥42𝑥2+1

  • First derivative: 𝑓(𝑥)=4𝑥34𝑥 (cubic)
  • Second derivative: 𝑓(𝑥)=12𝑥24 (quadratic)
  • Third derivative: 𝑓(𝑥)=24𝑥 (linear)
  • Fourth derivative: 𝑓(𝑥)=24 (constant)
  • Fourth derivative: 𝑓′′′′′(𝑥)=0 (zero)

100.0.1. Power Rule

𝑓(𝑥)=𝑥𝑛𝑓(𝑥)=𝑛𝑥𝑛1
Example
𝑓(𝑥)=𝑥3𝑓(𝑥)=3𝑥2

100.0.2. Product Rule

𝑓(𝑥)=𝑢(𝑥)𝑣(𝑥)𝑓(𝑥)=𝑢(𝑥)𝑣(𝑥)+𝑢(𝑥)𝑣(𝑥)
Example
𝑓(𝑥)=𝑥2𝑥3𝑢(𝑥)=𝑥2𝑣(𝑥)=𝑥3
  1. Compute the derivatives of 𝑢(𝑥) and 𝑣(𝑥)
𝑢(𝑥)=2𝑥𝑣(𝑥)=3𝑥2
  1. Apply rule
𝑓(𝑥)=(2𝑥)(𝑥3)+(𝑥2)(3𝑥2)=2𝑥2+3𝑥4=5𝑥4

100.0.3. Quotient Rule

𝑓(𝑥)=𝑢(𝑥)𝑣(𝑥)𝑓(𝑥)=𝑢(𝑥)𝑣(𝑥)𝑢(𝑥)𝑣(𝑥)𝑣(𝑥)2
Example
𝑓(𝑥)=𝑥3𝑥2𝑢(𝑥)=𝑥3𝑣(𝑥)=𝑥2
  1. Compute the derivatives of 𝑢(𝑥) and 𝑣(𝑥)
𝑢(𝑥)=3𝑥2𝑣(𝑥)=2𝑥
  1. Apply rule
𝑓(𝑥)=(3𝑥2)(𝑥2)(𝑥3)(2𝑥)(𝑥2)2=3𝑥42𝑥4𝑥4=𝑥4𝑥4=1

100.0.4. Chain Rule

𝑓(𝑔(𝑥))𝑓(𝑥)=𝑓(𝑔(𝑥))𝑔(𝑥)
Example
𝑓(𝑥)=(2𝑥+1)3
  • Outer function:
𝑓(𝑢)=𝑢3
  • Inner function
𝑔(𝑥)=2𝑥+1
  1. Compute the derivatives of 𝑓(𝑢) and 𝑔(𝑥)
𝑓(𝑢)=3𝑢2𝑔(𝑥)=2
  1. Apply rule
𝑓(𝑥)=3(2𝑥+1)22=6(2𝑥+1)2

100.0.5. Others

1. Trigonometric Functions

𝑑𝑑𝑥[sin(𝑥)]=cos(𝑥)𝑑𝑑𝑥[cos(𝑥)]=sin(𝑥)𝑑𝑑𝑥[tan(𝑥)]=sec2(𝑥)𝑑𝑑𝑥[cot(𝑥)]=csc2(𝑥)𝑑𝑑𝑥[sec(𝑥)]=sec(𝑥)tan(𝑥)𝑑𝑑𝑥[csc(𝑥)]=csc(𝑥)cot(𝑥)

2. Inverse Trigonometric Functions

𝑑𝑑𝑥[arcsin(𝑥)]=11𝑥2𝑑𝑑𝑥[arccos(𝑥)]=11𝑥2𝑑𝑑𝑥[arctan(𝑥)]=11+𝑥2𝑑𝑑𝑥[arccot(𝑥)]=11+𝑥2𝑑𝑑𝑥[arcsec(𝑥)]=1|𝑥|𝑥21𝑑𝑑𝑥[arccsc(𝑥)]=1|𝑥|𝑥21

3. Exponential and Logarithmic Functions

𝑑𝑑𝑥[𝑒𝑥]=𝑒𝑥𝑑𝑑𝑥[𝑎𝑥]=𝑎𝑥ln(𝑎)𝑑𝑑𝑥[ln(𝑥)]=1𝑥𝑑𝑑𝑥[log𝑎(𝑥)]=1𝑥ln(𝑎)

Definition 0: Stationary Point

A stationary point of a function 𝑓(𝑥) is a solution to

𝑓(𝑥)=0

That is, where the slope (derivative) is zero.

  • In 1D, this means the tangent line is horizontal
  • In nD, it means the gradient vector 𝑓(𝑥)=0