2020 IEEE International Symposium
on Information Theory
21-26 June 2020 • Los Angeles, California, USA
| Paper ID | S.13.2 | ||
| Paper Title | Empirical Properties of Good Channel Codes | ||
| Authors | Qinghua (Devon) Ding, Sidharth Jaggi, Chinese University of Hong Kong, China; Shashank Vatedka, Indian Institute of Technology Hyderabad, India; Yihan Zhang, Chinese University of Hong Kong, China | ||
| Session | S.13: Topics in Shannon Theory | ||
| Presentation | Lecture | ||
| Track | Shannon Theory | ||
| Manuscript | Click here to download the manuscript | ||
| Virtual Presentation | Click here to watch in the Virtual Symposium | ||
| Abstract | In this article, we revisit the classical problem of channel coding and obtain novel results on properties of capacity-achieving codes. Specifically, we give a linear algebraic characterization of the set of capacity-achieving input distributions for discrete memoryless channels. This allows us to characterize the dimension of the manifold on which the capacity-achieving distributions lie. We then proceed by examining empirical properties of capacity-achieving codebooks by showing that the joint-type of $ k $-tuples of codewords in a good code must be close ot the $ k $-fold product of the capacity-achieving input distribution. While this conforms with the intuition that all capacity-achieving codes must behave like random capacity-achieving codes, we also show that some properties of random coding ensembles do not hold for all codes. We prove this by showing that there exist pairs of communication problems such that random code ensembles simultaneously attain capacities of both problems, but certain (superposition ensembles) do not. | ||
Plan Ahead
2021 IEEE International Symposium on Information Theory
11-16 July 2021 | Melbourne, Victoria, Australia
