Information Theory and Coding - Solved Problems

This book is offers a comprehensive overview of information theory and error control coding, using a different approach then in existed literature. The chapters are organized according to the Shannon system model, where one block affects the others. A relatively brief theoretical introduction is provided at the beginning of every chapter, including a few additional examples and explanations, but without any proofs. And a short overview of some aspects of abstract algebra is given at the end of the corresponding chapters. The characteristic complex examples with a lot of illustrations and tables are chosen to provide detailed insights into the nature of the problem. Some limiting cases are presented to illustrate the connections with the theoretical bounds. The numerical values are carefully selected to provide in-depth explanations of the described algorithms. Although the examples in the different chapters can be considered separately, they are mutually connected and the conclusions for one considered problem relate to the others in the book.

Explains the basic principles of information theory and coding using complex numerical examples with detailed solutions Can be treated as illustrated account of an information processing system, suitable for step-by-step learning Offers a short introduction to linear algebra, and finite fields are given in appendices, which means readers don't require a high level of mathematical skills Color figures and illustrative limiting cases enable readers to easily understand this complex topic Carefully chooses the numerical values to provide in-depth explanations of the described algorithms

Inhalt

Introduction.- Information Sources.- Data Compression.- Information Channels.- Block Codes.- Cyclic Codes.- Convolutional Codes and Viterbi Algorithm.- Trellis Decoding of Linear Block Codes, Turbo Codes.- Low Density Parity Check Codes.