First-Order Ordinary Differential Equations
Theory What a differential equation is
F(x,y,y′)=0⟶y′=f(x,y) y(x0)=y0(initial value problem) y′=f(x,y)⇒slope f(x,y) at each point Separable variables
∫h(y)dy=∫g(x)dx+C h(y0)=0⇒y≡y0 constant solution y′=ky⟹y=y0ek(x−x0) First-order linear equations
μ(x)=e∫P(x)dx (μy)′=μQ y=μ1(∫μQdx+C) Bernoulli equation
z′+(1−n)P(x)z=(1−n)Q(x) y=z1/(1−n) Homogeneous equations and y'=f(y/x)
v=xy,y′=v+xv′ xdxdv=F(v)−v ∫F(v)−vdv=ln∣x∣+C Exact equations and integrating factors
∂yM=∂xN⇔exact Fx=M,Fy=N⇒F(x,y)=C μx=e∫NMy−Nxdx Existence and uniqueness: the Cauchy theorems
f continuous⇒∃ solution (Peano) ∣f(x,y1)−f(x,y2)∣≤L∣y1−y2∣⇒∃!(Picard) y′=∣y∣,y(0)=0: y≡0 and y=x2/4 Second-Order ODEs and Linear Systems
Theory What a second-order ODE is
ay′′+by′+cy=f(x) y(x0)=y0,y′(x0)=y0′ F=mx′′(Newton’s 2nd law) Structure of the general solution and the Wronskian
W(y1,y2)=y1y2′−y1′y2 W=0⟺y1,y2 independent y=C1y1+C2y2+yP Characteristic equation (constant coefficients)
aλ2+bλ+c=0,Δ=b2−4ac Δ>0:C1eλ1x+C2eλ2x Δ=0:(C1+C2x)eλx Δ<0:eαx(C1cosβx+C2sinβx) Particular solution: undetermined coefficients
y′′+py′+qy=ekx⇒yP=k2+pk+qekx(if k2+pk+q=0) resonance⇒multiply by x Variation of parameters
u1′=−aWy2f,u2′=aWy1f yP=u1y1+u2y2 Mechanical vibrations, damping and resonance
mx′′+γx′+kx=F0cosωt ω0=k/m xP=2mω0F0tsin(ω0t)(resonance) Linear differential systems
x′=Ax det(A−λI)=λ2−tr(A)λ+det(A)=0 x=C1eλ1tv1+C2eλ2tv2 Classifying equilibria (trace–determinant plane)
τ=tr(A),δ=det(A) stable⟺τ<0 and δ>0 saddle⟺δ<0,centre⟺τ=0,δ>0 Parametric curves
r(t)=(x(t),y(t),z(t)) T^(t)=∣r′(t)∣r′(t) regular⟺r′(t)=0∀t Arc length
L=∫abx′2+y′2+z′2dt ds=∣r′(t)∣dt L=∫αβr2+r′2dθ(polar) Curvature and the osculating circle
κ=dsdT^=∣r′∣3∣r′×r′′∣ κ=(1+y′2)3/2∣y′′∣ ρ=κ1(radius of curvature) Line integral of the 1st kind (scalar function)
∫γfds=∫abf(r(t))∣r′(t)∣dt mass=∫γρds,fˉ=L1∫γfds Line integral of the 2nd kind (work)
∫γF⋅dr=∫ab(Px′+Qy′+Rz′)dt ∫−γF⋅dr=−∫γF⋅dr Conservative fields and potential
F=∇U⟹∫γF⋅dr=U(B)−U(A) ∮γF⋅dr=0(conservative field) ∂yP=∂xQ(on a simply connected domain) Polar coordinates and notable curves
x=rcosθ,y=rsinθ A=21∫αβr2dθ r=a(1+cosθ)(cardioid) The Frenet frame (outline)
N^=T^′/∣T^′∣,B^=T^×N^ T^′=κN^,B^′=−τN^ τ=0⟺plane curve Multivariable Differential Calculus
Theory Functions of several variables: domain and level curves
f:R2→R,(x,y)↦f(x,y) Lc={x∈Rn:f(x)=c} Limits and continuity in ℝⁿ
∀ε>0∃δ>0:∣x−x0∣<δ⟹∣f(x)−L∣<ε different limits on two paths⇒∄lim Partial derivatives and differentiability
∂xf=h→0limhf(x0+h,y0)−f(x0,y0) f(x0+h)=f(x0)+∇f⋅h+o(∣h∣) f∈C1⇒f differentiable⇒f continuous Gradient and directional derivative
∇f=(∂xf,∂yf) Dv^f=∇f⋅v^≤∣∇f∣ ∇f⊥Lc(level curves) Tangent plane and Taylor formula
z=f0+fx(x−x0)+fy(y−y0) f(x0+h)≈f0+∇f⋅h+21hTHfh Critical points and classification by the Hessian
∇f(x0)=0(critical point) Hf=(fxxfyxfxyfyy),detHf=fxxfyy−fxy2 detH>0,fxx>0⇒min;detH<0⇒saddle Chain rule and the implicit function theorem
dtdf(r(t))=∇f⋅r′(t) Fx+Fyφ′=0⇒φ′(x)=−FyFx Constrained optimisation: Lagrange multipliers
∇f=λ∇g,g(x,y)=0 ⎩⎨⎧fx=λgxfy=λgyg=0 Vector-Valued Functions and Manifolds
Theory Vector functions: fields, transformations, surfaces
f:Rn→Rm,f=(f1,…,fm) r(u,v):R2→R3(surface) The Jacobian matrix
Jf=∂1f1⋮∂1fm⋯⋯∂nf1⋮∂nfm f(x0+h)≈f(x0)+Jfh ∣detJf∣=volume-scaling factor Vector chain rule
Jf∘g(x)=Jf(g(x))⋅Jg(x) (m×n)⋅(n×p)=m×p The inverse function theorem
detJf(x0)=0⟹f locally invertible Jf−1=[Jf]−1 The implicit function theorem (vector form)
det(∂F/∂y)=0⇒y=g(x) Jg=−(∂y∂F)−1∂x∂F Parametric surfaces, normal and area
n=ru×rv dS=∣ru×rv∣dudv A=∬D∣ru×rv∣dudv Lagrange multipliers (several constraints)
∇f=λ∇g,g=0 ∇f=i=1∑kλi∇gi,g1=⋯=gk=0 Change of coordinates and the Jacobian in integrals
∬T(D)fdxdy=∬Df(T)∣detJT∣dudv dxdy=rdrdθ(polar) dV=ρ2sinϕdρdϕdθ(spherical) From the single to the double integral
∬DfdA=ΔA→0limi∑f(xi,yi)ΔA ∬D1dA=area(D) Fubini's theorem (iterated integration)
∬RfdA=∫ab∫cdfdydx=∫cd∫abfdxdy f continuous⇒order swappable Normal domains and swapping the order
Dy-norm={a≤x≤b, g1(x)≤y≤g2(x)} ∬Df=∫ab∫g1(x)g2(x)fdydx Polar coordinates in the plane
x=rcosθ, y=rsinθ,dA=rdrdθ ∬DfdA=∫αβ∫0R(θ)frdrdθ The triple integral
∭VfdV=∫ab∫g1g2∫h1h2fdzdydx ∭V1dV=volume(V) Cylindrical and spherical coordinates
dVcyl=rdrdθdz dVsph=ρ2sinϕdρdϕdθ x2+y2+z2=ρ2 The general change-of-variables formula
∬Dfdxdy=∬D∗f(Φ)∣detJΦ∣dudv JΦ=∂(u,v)∂(x,y) Applications: mass, centroid, moment of inertia
m=∭VρdV xˉ=m1∭VxρdV Iz=∭V(x2+y2)ρdV Vector Fields and Integral Theorems
Theory What a vector field is
F:Rn→Rn,x↦F(x) r′(t)=F(r(t))(flow lines) Divergence and curl
∇⋅F=∂xP+∂yQ+∂zR ∇×F=(Ry−Qz,Pz−Rx,Qx−Py) ∇⋅F>0:source,<0:sink Conservative fields and potential
F=∇U⟺∇×F=0(s.c. domain) ∇×(∇U)=0 ∮γF⋅dr=0 on every closed curve Surface integral (flux)
Φ=∬ΣF⋅n^dS =∬DF⋅(ru×rv)dudv Green's theorem in the plane
∮∂D(Pdx+Qdy)=∬D(Qx−Py)dA A=21∮∂D(xdy−ydx) The Divergence theorem (Gauss)
∬∂VF⋅dS=∭V(∇⋅F)dV ∇⋅E=ρ/ε0(Gauss) Stokes' theorem
∮∂ΣF⋅dr=∬Σ(∇×F)⋅dS ∮B⋅dr=μ0I(Ampeˋre) The three formulas as one idea
∇⋅(∇×F)=0 ∫Ωdω=∫∂Ωω(general Stokes) Power Series, Fourier Series, and Transforms
Theory Numerical series — convergence tests
lim∣an+1/an∣=L<1⟹abs. conv. limsupn∣an∣=L<1⟹abs. conv. ∑(−1)nbn,bn↘0⟹converges (Leibniz) n=1∑∞1/np converges ⟺p>1 Power series and radius of convergence
R=1/limsupn∣cn∣ ∣x−x0∣<R⟹abs. conv. f′(x)=∑ncn(x−x0)n−1(same R) Taylor series and notable expansions
f(x)=n=0∑∞n!f(n)(x0)(x−x0)n ex=∑xn/n!,sinx=∑(−1)nx2n+1/(2n+1)! ln(1+x)=∑(−1)n−1xn/n,∣x∣≤1 (nα)=n!α(α−1)⋯(α−n+1) Fourier series — periods and coefficients
f(x)∼2a0+n=1∑∞(ancosLnπx+bnsinLnπx) an=L1∫−LLf(x)cosLnπxdx,bn=L1∫−LLf(x)sinLnπxdx cn=2L1∫−LLf(x)e−inπx/Ldx f even⇒bn=0,f odd⇒an=0 Convergence of Fourier series and Gibbs phenomenon
f(x±)=h→0+limf(x±h) Dirichlet: 2f(x+)+f(x−) at discontinuities Parseval: 2L1∫−LL∣f∣2=−∞∑∞∣cn∣2 Fourier transform — from discrete to continuous
f^(ξ)=∫−∞∞f(x)e−2πiξxdx f(x)=∫−∞∞f^(ξ)e2πiξxdξ f′=2πiξf^,f∗g=f^g^ Laplace transform
F(s)=∫0∞f(t)e−stdt L{f′}=sF(s)−f(0),L{f′′}=s2F(s)−sf(0)−f′(0) L{eat}=1/(s−a),L{sinωt}=ω/(s2+ω2) Applications: ODEs, circuits, and control
L{y(n)}=snY(s)−sn−1y(0)−⋯−y(n−1)(0) t→∞limf(t)=s→0limsF(s)(final value) H(s)=Y(s)/U(s)(transfer function)