Correlated source coding and decoder side information
Research context
postgraduate concept · established · As of 2026-10-10
For independent repetitions of a finite-alphabet joint law p(x,y), an encoder observing X and a decoder possessing Y can recover X with vanishing block error at rates above H(X|Y); rates below it are impossible.
Key knowledge
For independent repetitions of a finite-alphabet joint law p(x,y), an encoder observing X and a decoder possessing Y can recover X with vanishing block error at rates above H(X|Y); rates below it are impossible. Random binning exploits correlation without revealing Y to the encoder. This is a Slepian–Wolf special case; separate encoders, lossy reconstruction, nonstationary sources or unavailable side information require their own regions.
Values and equations
R_X > H(X|Y) is achievable asymptotically
- R_X
- Encoder rate, bits per source symbol
- X,Y
- Finite-alphabet iid correlated source pairs
Conditions and scope
- The pairs are iid with a known joint law, block length tends to infinity and Y is available at the decoder.
- An asymptotic existence theorem does not give a finite-block decoder latency or reliability guarantee.
Sources · 1
References
Sources retain their recorded scope. A source link alone does not establish verification of every statement.
Evidence and review
Author checked this English statement, displayed equation where present and stated hypotheses against these source locations: DM-MAC pp. 28–35, broadcast pp. 38–47, distortion pp. 48–52, Wyner–Ziv/Slepian–Wolf pp. 53–59, relay pp. 78–94, multicast pp. 100–116. The check is bounded to the recorded claims; no complete proof reconstruction, software proof replay or universal literature completeness is claimed.
2026-10-10 · Author source-body/statement/equation/domain check, with graph associations scoped individually. Separate independent content/source/inventory review is required before branch closure.
Entry details
Permanent link to this entry ↗- Record identity
- research-info-correlated-source-binning
- Revision
- research.1
- Structured reference record
- Postgraduate & research reference