Optical Modulation Formats Compared: QPSK vs 8QAM vs 16QAM vs 64QAM

A coherent transceiver's datasheet lists its modulation format — DP-QPSK, DP-16QAM, probabilistically shaped 64QAM. The choice determines the fundamental tradeoff between capacity and reach. Higher-order modulation packs more bits per symbol, but requires higher signal-to-noise ratio — meaning shorter reach. Understanding this tradeoff helps you read datasheets critically and avoid specifying a modulation format that cannot close your link.

How Modulation Formats Work

In coherent optics, each symbol is a point on a constellation diagram — a 2D map of phase and amplitude. The more points in the constellation, the more bits each symbol carries, but the closer the points are to each other, making them harder to distinguish in the presence of noise.

The OSNR-Reach Tradeoff: Every 3 dB Doubles or Halves Reach

Each step up the modulation ladder — QPSK → 8QAM → 16QAM → 64QAM — adds roughly 3–4 dB to the required OSNR. Since fiber loss is 0.25 dB/km at 1550 nm, every 3 dB of OSNR margin translates to roughly 12 km of reach. But OSNR also depends on amplifier noise and span count, which is why modern coherent DSPs switch modulation format dynamically — 16QAM when OSNR is good, dropping to QPSK when a span degrades.

Probabilistic Shaping: Why Modern Coherent DSPs Are Not Fixed-Format

Modern coherent DSPs do not lock into a single modulation format. Probabilistic constellation shaping (PCS) adjusts the symbol distribution continuously — using 16QAM-like constellations but with outer symbols transmitted less frequently to reduce the required OSNR. The result: the transceiver finds the optimal point on the capacity-reach curve for the actual link, rather than being limited to the worst-case OSNR of a fixed format.

Practical takeaway: When evaluating coherent transceivers, look for PCS support — it means the module adapts its modulation to actual link conditions rather than operating at a fixed capacity-reach point. Two modules both labeled "DP-16QAM" will perform differently if one uses fixed 16QAM and the other uses probabilistically shaped 16QAM — the PCS version will close links with 1–2 dB worse OSNR.

APEX Group 400G CFP2-DCO and 800G QSFP-DD ZR+ coherent transceivers implement probabilistically shaped DP-16QAM and DP-8QAM, adapting continuously to link OSNR for optimal capacity at every reach.

APEX GROUP — www.apexallinone.com