Engineering Mathematics: Complex Analysis and Z-Transform Complete Guide

In electrical and control engineering, complex numbers are far more than a mathematical abstraction. Phasors in AC circuit analysis, $s = \sigma + j\omega$ in the Laplace transform, the unit circle in the Z-transform, complex frequency response in Bode plots — all of these are rooted in complex analysis. This guide takes you from the complex number system through the residue theorem, Z-transform, and digital filter design.

1. The Complex Number System

1.1 Representations of Complex Numbers

Rectangular Form: $z = x + iy = x + jy$

(Electrical engineers use $j$ instead of $i$, since $i$ denotes current.)

• Real part: $\text{Re}(z) = x$
• Imaginary part: $\text{Im}(z) = y$

Polar Form: $z = r e^{i\theta} = r(\cos\theta + i\sin\theta) = r\angle\theta$

• Magnitude: $r = |z| = \sqrt{x^2 + y^2}$
• Argument (phase): $\theta = \arg(z) = \arctan(y/x)$ (accounting for quadrant)

Euler's Formula: $e^{i\theta} = \cos\theta + i\sin\theta$

From this: $\cos\theta = \frac{e^{i\theta} + e^{-i\theta}}{2}, \quad \sin\theta = \frac{e^{i\theta} - e^{-i\theta}}{2i}$

Often called the most beautiful formula in mathematics, Euler's Identity: $e^{i\pi} + 1 = 0$

Five of the most important numbers ($e$, $i$, $\pi$, $1$, $0$) united in a single equation.

De Moivre's Formula: $(r e^{i\theta})^n = r^n e^{in\theta} = r^n(\cos n\theta + i\sin n\theta)$

n-th roots: $z^{1/n} = r^{1/n} e^{i(\theta + 2k\pi)/n}$, $k = 0, 1, \ldots, n-1$

These represent $n$ equally-spaced points on the unit circle. (The n-th roots of unity: $W_N^k = e^{j2\pi k/N}$ — you will see these in the FFT!)

1.2 Complex Arithmetic

Addition/Subtraction (rectangular form is convenient): $(x_1 + iy_1) \pm (x_2 + iy_2) = (x_1 \pm x_2) + i(y_1 \pm y_2)$

Multiplication (polar form is convenient): $(r_1 e^{i\theta_1})(r_2 e^{i\theta_2}) = r_1 r_2 e^{i(\theta_1 + \theta_2)}$

Magnitudes multiply, phases add — the foundation of impedance multiplication in electrical engineering.

Division: $\frac{r_1 e^{i\theta_1}}{r_2 e^{i\theta_2}} = \frac{r_1}{r_2} e^{i(\theta_1 - \theta_2)}$

Complex Conjugate: $\bar{z} = x - iy = r e^{-i\theta}$

Useful properties:

• $z\bar{z} = x^2 + y^2 = |z|^2$
• $\text{Re}(z) = (z + \bar{z})/2$
• $\text{Im}(z) = (z - \bar{z})/(2i)$

1.3 Engineering Application: Phasor Analysis

The power of complex numbers is on full display in AC circuit analysis.

Expressing $v(t) = V_m\cos(\omega t + \phi)$ as a phasor: $\mathbf{V} = V_m e^{j\phi} = V_m\angle\phi$

Impedance:

$Z_R = R \quad \text{(pure resistance, no phase shift)}$ $Z_L = j\omega L \quad \text{(inductor, +90 degrees phase lead)}$ $Z_C = \frac{1}{j\omega C} = \frac{-j}{\omega C} \quad \text{(capacitor, -90 degrees phase lag)}$

Series RLC impedance: $Z = R + j\omega L + \frac{1}{j\omega C} = R + j\left(\omega L - \frac{1}{\omega C}\right)$

Resonance condition: $\omega_0 L = 1/(\omega_0 C)$ implies $\omega_0 = 1/\sqrt{LC}$, $Z = R$ (pure resistance).

2. Complex Functions and Analytic Functions

2.1 Complex Functions

$f(z) = f(x + iy) = u(x, y) + iv(x, y)$

where $u$ and $v$ are real-valued functions.

Examples: $f(z) = z^2 = (x+iy)^2 = x^2 - y^2 + i(2xy)$

$u(x,y) = x^2 - y^2, \quad v(x,y) = 2xy$

$f(z) = e^z = e^{x+iy} = e^x(\cos y + i\sin y)$

$u(x,y) = e^x\cos y, \quad v(x,y) = e^x\sin y$

2.2 Complex Differentiation and the Cauchy-Riemann Equations

The complex derivative of $f(z)$: $f'(z_0) = \lim_{\Delta z\to 0}\frac{f(z_0 + \Delta z) - f(z_0)}{\Delta z}$

Unlike real analysis, $\Delta z$ can approach 0 from any direction in the complex plane, and the limit must be the same regardless of direction.

Along the real axis ($\Delta z = \Delta x$): $f'(z) = \frac{\partial u}{\partial x} + i\frac{\partial v}{\partial x}$

Along the imaginary axis ($\Delta z = i\Delta y$): $f'(z) = -i\frac{\partial u}{\partial y} + \frac{\partial v}{\partial y}$

For these two expressions to be equal:

$\boxed{\frac{\partial u}{\partial x} = \frac{\partial v}{\partial y}, \quad \frac{\partial u}{\partial y} = -\frac{\partial v}{\partial x}}$

These are the Cauchy-Riemann Equations.

If the partial derivatives of $u$ and $v$ are continuous and satisfy the Cauchy-Riemann equations, $f(z)$ is an analytic function.

2.3 Harmonic Functions

The real and imaginary parts of an analytic function each satisfy Laplace's equation:

$\nabla^2 u = \frac{\partial^2 u}{\partial x^2} + \frac{\partial^2 u}{\partial y^2} = 0, \quad \nabla^2 v = \frac{\partial^2 v}{\partial x^2} + \frac{\partial^2 v}{\partial y^2} = 0$

From Cauchy-Riemann: $u_{xx} = v_{yx}$ and $u_{yy} = -v_{xy}$, so $u_{xx} + u_{yy} = 0$.

Given $u$, the Cauchy-Riemann equations allow you to find the harmonic conjugate $v$.

Engineering significance: velocity potential and stream function in potential flow; electric potential and field lines in electrostatics.

import numpy as np
import matplotlib.pyplot as plt

# Visualize Cauchy-Riemann orthogonality for f(z) = z^2
x = np.linspace(-2, 2, 400)
y = np.linspace(-2, 2, 400)
X, Y = np.meshgrid(x, y)

U = X**2 - Y**2   # Re(z^2)
V = 2 * X * Y     # Im(z^2)

fig, axes = plt.subplots(1, 2, figsize=(12, 5))
for ax, data, title in zip(axes, [U, V],
        ['Re(z^2) = x^2 - y^2', 'Im(z^2) = 2xy']):
    c = ax.contour(X, Y, data, levels=20, cmap='RdBu')
    ax.set_title(title)
    ax.set_xlabel('x')
    ax.set_ylabel('y')
    ax.set_aspect('equal')
    plt.colorbar(c, ax=ax)

plt.suptitle('Level curves of f(z)=z^2: orthogonal grids (Cauchy-Riemann)', fontsize=12)
plt.tight_layout()
plt.savefig('cauchy_riemann_z2.png', dpi=150)
plt.show()

2.4 Important Analytic Functions

Trigonometric functions: $\cos z = \frac{e^{iz} + e^{-iz}}{2}, \quad \sin z = \frac{e^{iz} - e^{-iz}}{2i}$

Unlike their real counterparts, they can become unbounded: $|\cos(iy)| = \cosh y \to \infty$.

Logarithm (multi-valued): $\ln z = \ln r + i(\theta + 2k\pi), \quad k \in \mathbb{Z}$

Principal value: $\text{Ln}\,z = \ln r + i\theta$, $-\pi < \theta \leq \pi$. Singularities occur at $z = 0$ and along the negative real axis (branch cut).

3. Complex Integration

3.1 Contour Integrals

$C$: a curve parameterized by $z(t) = x(t) + iy(t)$, $a \leq t \leq b$

$\int_C f(z)\,dz = \int_a^b f(z(t))z'(t)\,dt$

Example: $\int_C z^2\,dz$ along the straight line from $0$ to $1+i$

Parameterization: $z(t) = t(1+i)$, $z'(t) = 1+i$, $0 \leq t \leq 1$

$\int_0^1 t^2(1+i)^2(1+i)\,dt = (2i)(1+i)\cdot\frac{1}{3} = \frac{-2+2i}{3}$

3.2 Cauchy's Integral Theorem

$\oint_C f(z)\,dz = 0$

Condition: $f(z)$ analytic on and inside the simple closed curve $C$.

Intuition: the integral of an analytic function is path-independent. Using Green's theorem together with the Cauchy-Riemann equations forces both real parts of the integral to vanish.

Antiderivative: if $F'(z) = f(z)$, then $\int_a^b f(z)\,dz = F(b) - F(a)$.

3.3 Cauchy's Integral Formula

$\boxed{f(a) = \frac{1}{2\pi i}\oint_C \frac{f(z)}{z-a}\,dz}$

Conditions: $f(z)$ analytic on and inside $C$; $a$ lies inside $C$.

Higher-order derivative formula: $f^{(n)}(a) = \frac{n!}{2\pi i}\oint_C \frac{f(z)}{(z-a)^{n+1}}\,dz$

This proves that analytic functions are infinitely differentiable.

import numpy as np

def cauchy_integral_formula(f, a, R=1.0, N=2000):
    """Numerically verify f(a) = (1/2pi*i) integral f(z)/(z-a) dz."""
    theta = np.linspace(0, 2*np.pi, N, endpoint=False)
    z = a + R * np.exp(1j * theta)
    dz = np.diff(np.append(z, z[0]))
    integrand = f(z[:-1]) / (z[:-1] - a)
    return np.sum(integrand * dz) / (2 * np.pi * 1j)

a = 1 + 1j
numerical = cauchy_integral_formula(np.exp, a)
print(f"Cauchy formula result : {numerical:.6f}")
print(f"Exact  exp(1+j)       : {np.exp(a):.6f}")
print(f"Error                 : {abs(numerical - np.exp(a)):.2e}")

4. Laurent Series and the Residue Theorem

4.1 Taylor Series vs Laurent Series

Taylor series (analytic at $z_0$): $f(z) = \sum_{n=0}^{\infty}a_n(z-z_0)^n, \quad a_n = \frac{f^{(n)}(z_0)}{n!}$

Laurent series (annular region $r_1 < |z - z_0| < r_2$):

$f(z) = \sum_{n=-\infty}^{\infty}a_n(z-z_0)^n$

The negative-power terms form the principal part. The difference: Laurent series can represent functions with singularities; the structure of the principal part classifies the singularity.

4.2 Classification of Singularities

Removable: no negative-power terms. Example: $\sin z / z$ at $z = 0$.

Pole of order m: finitely many negative-power terms; $f(z) = g(z)/(z-z_0)^m$ with $g$ analytic and $g(z_0) \neq 0$.

Essential singularity: infinitely many negative-power terms. Example: $e^{1/z}$ at $z = 0$.

Picard's theorem: near an essential singularity, $f$ takes almost every complex value.

4.3 The Residue Theorem

Residue: the coefficient of $(z-z_0)^{-1}$ in the Laurent expansion.

$\text{Res}[f, z_0] = b_1 = \frac{1}{2\pi i}\oint_{|z-z_0|=\epsilon} f(z)\,dz$

Computing residues:

Simple pole: $\text{Res}[f, z_0] = \lim_{z\to z_0}(z - z_0)f(z)$

Rational $f = p/q$ at a simple pole: $\text{Res}[f, z_0] = p(z_0)/q'(z_0)$

Pole of order $m$: $\text{Res}[f, z_0] = \frac{1}{(m-1)!}\lim_{z\to z_0}\frac{d^{m-1}}{dz^{m-1}}\left[(z-z_0)^m f(z)\right]$

Residue Theorem: $\oint_C f(z)\,dz = 2\pi i \sum_k \text{Res}[f, z_k]$

where $z_k$ are all singularities inside $C$.

4.4 Evaluating Real Integrals

Example 1: $\displaystyle\int_{-\infty}^{\infty}\frac{dx}{1+x^2}$

Pole in the upper half-plane: $z = i$. Residue: $1/(2i)$. By the residue theorem and Jordan's lemma: $I = 2\pi i \cdot \frac{1}{2i} = \pi$

Example 2: $\displaystyle\int_0^{\infty}\frac{\cos x}{x^2+a^2}dx \quad (a > 0)$

Consider $f(z) = e^{iz}/(z^2+a^2)$. Pole at $z = ia$, residue $e^{-a}/(2ia)$. Taking the real part: $I = \pi e^{-a}/(2a)$.

Example 3: $\displaystyle\int_0^{2\pi}\frac{d\theta}{2+\cos\theta}$

Substitute $z = e^{i\theta}$, $\cos\theta = (z + z^{-1})/2$: $= \oint\frac{2\,dz}{i(z^2+4z+1)} = \frac{2\pi}{\sqrt{3}}$

4.5 Inverse Laplace Transform via Residues

Bromwich Integral: $f(t) = \frac{1}{2\pi i}\int_{\sigma-i\infty}^{\sigma+i\infty}F(s)e^{st}\,ds = \sum_k \text{Res}\left[F(s)e^{st}, s_k\right]$

Example: $F(s) = 1/(s^2+\omega^2)$, poles $s = \pm i\omega$

$f(t) = \frac{e^{i\omega t}}{2i\omega} + \frac{e^{-i\omega t}}{-2i\omega} = \frac{\sin\omega t}{\omega}$

5. Conformal Mappings

5.1 Definition and Angle Preservation

An analytic function $w = f(z)$ with $f'(z) \neq 0$ defines a conformal mapping: it preserves angles and orientation between curves at every point.

5.2 Mobius Transformation

$w = \frac{az + b}{cz + d}, \quad ad - bc \neq 0$

Properties:

• Maps circles and lines to circles and lines
• Any three distinct points can be mapped to any other three
• Composition of Mobius maps is again a Mobius map

Key examples:

• $w = 1/z$: inversion
• $w = (z - a)/(1 - \bar{a}z)$: maps the unit disk to itself
• $w = (1 + z)/(1 - z)$: maps the unit disk to the right half-plane

5.3 Engineering Applications

Potential flow: conformal mappings transform complicated domain geometries (e.g., airfoils) into simple ones (half-plane, disk), enabling analytic solutions.

Electrostatics: find field distributions between irregular electrodes by mapping to standard geometries.

Digital filter design: the bilinear transform $s = 2(z-1)/[T_s(z+1)]$ is a conformal map converting the $j\omega$ axis exactly onto the unit circle.

import numpy as np
import matplotlib.pyplot as plt

def mobius(z, a=1, b=-1, c=1, d=1):
    return (a * z + b) / (c * z + d)

theta = np.linspace(0, 2*np.pi, 300)
r_vals = [0.3, 0.6, 0.9, 1.0]

fig, axes = plt.subplots(1, 2, figsize=(12, 6))

for r in r_vals:
    z_c = r * np.exp(1j * theta)
    w_c = mobius(z_c)
    axes[0].plot(z_c.real, z_c.imag, linewidth=1.5)
    axes[1].plot(w_c.real, w_c.imag, linewidth=1.5)

for phi in np.linspace(0, 2*np.pi, 12, endpoint=False):
    r_line = np.linspace(0.01, 0.99, 100)
    z_l = r_line * np.exp(1j * phi)
    w_l = mobius(z_l)
    axes[0].plot(z_l.real, z_l.imag, 'gray', alpha=0.4, linewidth=0.8)
    axes[1].plot(w_l.real, w_l.imag, 'gray', alpha=0.4, linewidth=0.8)

for ax, title in zip(axes, ['z-plane (unit disk)', 'w-plane: w = (z-1)/(z+1)']):
    ax.set_xlim([-2, 2])
    ax.set_ylim([-2, 2])
    ax.axhline(0, color='k', linewidth=0.5)
    ax.axvline(0, color='k', linewidth=0.5)
    ax.set_aspect('equal')
    ax.set_title(title)
    ax.grid(True, alpha=0.3)

plt.tight_layout()
plt.savefig('mobius_transform.png', dpi=150)
plt.show()

6. Z-Transform

6.1 Definition and Region of Convergence

$X(z) = \mathcal{Z}\{x[n]\} = \sum_{n=-\infty}^{\infty}x[n]z^{-n}$

Region of Convergence (ROC):

• Causal signal: $|z| > r_{\max}$
• Anti-causal signal: $|z| < r_{\min}$
• Two-sided signal: annular region $r_1 < |z| < r_2$

6.2 Key Z-Transform Pairs

| Signal $x[n]$ | $X(z)$ | ROC | | --------------------------- | ------------------------------------------ | ------- | --- | --- | --- | --- | | $\delta[n]$ | $1$ | all $z$ | | $u[n]$ | $z/(z-1)$ | $| z | >1$ | | $a^n u[n]$ | $z/(z-a)$ | $| z | > | a |$ | | $\cos\Omega_0 n \cdot u[n]$ | $z(z-\cos\Omega_0)/(z^2-2z\cos\Omega_0+1)$ | $| z | >1$ | | $nu[n]$ | $z/(z-1)^2$ | $| z | >1$ |

6.3 Properties of the Z-Transform

• Time shift: $\mathcal{Z}\{x[n-k]\} = z^{-k}X(z)$ ($z^{-1}$ = unit delay operator)
• Convolution: $\mathcal{Z}\{x[n]*h[n]\} = X(z)H(z)$
• Final value: $\lim_{n\to\infty} x[n] = \lim_{z\to 1}(z-1)X(z)$

6.4 Digital Filter Design

Transfer function: $H(z) = \frac{b_0 + b_1 z^{-1} + \cdots + b_M z^{-M}}{1 + a_1 z^{-1} + \cdots + a_N z^{-N}}$

Stability: all poles must satisfy $|p_k| < 1$.

FIR: poles only at origin — always stable, can achieve linear phase.

IIR: feedback poles can be anywhere — sharper characteristics with fewer coefficients, but requires stability check.

from scipy import signal
import numpy as np
import matplotlib.pyplot as plt

b, a = signal.butter(4, 0.2, btype='low')
w, h = signal.freqz(b, a, worN=2048)
zeros, poles, gain = signal.tf2zpk(b, a)

fig, axes = plt.subplots(1, 2, figsize=(12, 5))

axes[0].plot(w/np.pi, 20*np.log10(abs(h) + 1e-15), 'b-', linewidth=2)
axes[0].axhline(-3, color='r', linestyle='--', label='-3 dB')
axes[0].set_xlabel('Normalized Frequency')
axes[0].set_ylabel('Magnitude (dB)')
axes[0].set_title('Butterworth LPF (order 4)')
axes[0].set_xlim([0, 1])
axes[0].legend()
axes[0].grid(True, alpha=0.3)

unit_circle = np.exp(1j * np.linspace(0, 2*np.pi, 200))
axes[1].plot(unit_circle.real, unit_circle.imag, 'k--', alpha=0.5)
axes[1].scatter(zeros.real, zeros.imag, s=100, marker='o', color='blue', label='Zeros')
axes[1].scatter(poles.real, poles.imag, s=100, marker='x', color='red', linewidths=2, label='Poles')
axes[1].set_title('Pole-Zero Plot (z-plane)')
axes[1].set_aspect('equal')
axes[1].legend()
axes[1].grid(True, alpha=0.3)

plt.tight_layout()
plt.savefig('butterworth_lpf.png', dpi=150)
plt.show()
print(f"Pole magnitudes: {np.abs(poles)}")

6.5 s-Plane to z-Plane Correspondence

$z = e^{sT_s}$

| s-plane | z-plane | | ------------------------------- | ------------- | --- | ---- | | $j\omega$ axis ($\sigma = 0$) | Unit circle $| z | = 1$ | | Left half-plane ($\sigma < 0$) | Interior $| z | < 1$ | | Right half-plane ($\sigma > 0$) | Exterior $| z | > 1$ |

Stability: continuous poles in left half-plane correspond to discrete poles inside the unit circle.

Bilinear transform (analog to digital without aliasing): $s = \frac{2}{T_s}\cdot\frac{z-1}{z+1}$

7. Applications to AI and Signal Processing

7.1 Complex-Valued Neural Networks

Complex-valued neural networks process signals in the amplitude-phase domain. The Wirtinger derivative generalizes complex differentiation to non-analytic functions used in machine learning, enabling gradient-based optimization in the complex domain.

7.2 Loss Landscape Geometry

Complex analysis tools characterize critical points of neural network loss functions. Saddle points, local minima, and their basins of attraction can be studied through the lens of analytic function theory and conformal geometry.

import numpy as np
import matplotlib.pyplot as plt

# Domain coloring of sin(z)/z — removable singularity at z=0
x = np.linspace(-5, 5, 600)
y = np.linspace(-3, 3, 600)
X, Y = np.meshgrid(x, y)
Z = X + 1j * Y

with np.errstate(invalid='ignore', divide='ignore'):
    F = np.where(np.abs(Z) < 1e-10, 1.0 + 0j, np.sin(Z) / Z)

fig, axes = plt.subplots(1, 2, figsize=(14, 5))
im1 = axes[0].pcolormesh(X, Y, np.abs(F), cmap='viridis', vmax=2.5)
axes[0].set_title('|sin(z)/z| — modulus')
axes[0].set_xlabel('Re(z)')
axes[0].set_ylabel('Im(z)')
axes[0].set_aspect('equal')
plt.colorbar(im1, ax=axes[0])

im2 = axes[1].pcolormesh(X, Y, np.angle(F), cmap='hsv')
axes[1].set_title('arg(sin(z)/z) — phase')
axes[1].set_xlabel('Re(z)')
axes[1].set_ylabel('Im(z)')
axes[1].set_aspect('equal')
plt.colorbar(im2, ax=axes[1])

plt.suptitle('Domain coloring of sin(z)/z (removable singularity at 0)', fontsize=12)
plt.tight_layout()
plt.savefig('domain_coloring_sinc.png', dpi=150)
plt.show()

Summary and Next Steps

Topics covered in this guide:

1. Complex number system: rectangular form, polar form, Euler's formula, De Moivre, phasor analysis, impedance
2. Complex functions and analytic functions: Cauchy-Riemann equations, harmonic functions
3. Complex integration: contour integrals, Cauchy's theorem, Cauchy's integral formula
4. Laurent series and the residue theorem: singularity classification, residue computation, real integrals, inverse Laplace
5. Conformal mappings: Mobius transformation, angle preservation, engineering applications
6. Z-transform: ROC, key transform pairs, solving difference equations
7. Digital filter design: FIR/IIR, pole-zero plots, stability, bilinear transform
8. AI applications: complex-valued networks, optimization landscape geometry

The next installment covers Numerical Methods: solving equations, numerical differentiation and integration, ODE solvers, and interpolation — all implemented in Python.

References

• Churchill, R. & Brown, J. "Complex Variables and Applications", 9th Edition
• Oppenheim, A. & Schafer, R. "Discrete-Time Signal Processing", 3rd Edition
• Proakis, J. & Manolakis, D. "Digital Signal Processing", 4th Edition
• Ogata, K. "Modern Control Engineering", 5th Edition
• SciPy signal processing documentation

Quiz