BCJR algorithm

The Bahl-Cocke-Jelinek-Raviv (BCJR) algorithm is an algorithm for maximum a posteriori decoding of error correcting codes defined on trellises (principally convolutional codes). The algorithm was introduced in 1974 by Lalit R. Bahl, John Cocke, Frederick Jelinek and Josef Raviv, whose surnames give it its name. It applies to both linear block codes and convolutional codes.

BCJR-based decoders provide soft outputs, which express the relative probabilities of possible symbol values. They are used as component decoders in iterative turbo decoding.

Algorithm

The algorithm combines a forward pass and a backward pass through the trellis. Let ${\displaystyle S_{k}}$ denote the encoder state at time ${\displaystyle k}$, and ${\displaystyle y_{1}^{N}=(y_{1},\ldots ,y_{N})}$ the received sequence. Its metrics are

${\displaystyle {\begin{aligned}\alpha _{k}(s)&=P(S_{k}=s,y_{1}^{k}),\\\beta _{k}(s)&=P(y_{k+1}^{N}\mid S_{k}=s),\\\gamma _{k}(s',s)&=P(S_{k}=s,y_{k}\mid S_{k-1}=s').\end{aligned}}}$

For continuous observations, the corresponding probability densities are used. The branch metric ${\displaystyle \gamma _{k}}$ incorporates the channel observation and the prior probability of the transition.

The forward and backward recursions are

${\displaystyle \alpha _{k}(s)=\sum _{s'}\alpha _{k-1}(s')\gamma _{k}(s',s),}$

${\displaystyle \beta _{k-1}(s')=\sum _{s}\gamma _{k}(s',s)\beta _{k}(s).}$

Initialisation reflects the available information about the encoder's initial and final states. The posterior probability of a transition is proportional to

${\displaystyle P(S_{k-1}=s',S_{k}=s\mid y_{1}^{N})\propto \alpha _{k-1}(s')\gamma _{k}(s',s)\beta _{k}(s).}$

Summing over transitions associated with a particular input symbol and normalising gives that symbol's posterior probability.

Steps involved

Based on the trellis:

• Compute forward probabilities ${\displaystyle \alpha }$
• Compute backward probabilities ${\displaystyle \beta }$
• Compute smoothed probabilities based on other information (i.e. noise variance for AWGN, bit crossover probability for binary symmetric channel)

Variations

Windowed BCJR

A modified version that processes the trellis in segments to reduce computational complexity and memory requirements. This approach is particularly useful for very long sequences where full trellis storage becomes impractical. The windowed version maintains near-optimal performance while significantly lowering latency and hardware resource utilization in implementations.

Implementations

• Susa framework implements BCJR algorithm for forward error correction codes and channel equalization in C++.

See also

• Forward–backward algorithm
• Maximum a posteriori (MAP) estimation
• Hidden Markov model

References

External links

• The online textbook: Information Theory, Inference, and Learning Algorithms, by David J.C. MacKay, discusses the BCJR algorithm in chapter 25.
• The implementation of BCJR algorithm in Susa signal processing framework

This algorithms or data structures-related article is a stub. You can help Wikipedia by adding missing information.

• v
• t
• e