Book contents
- Fundamentals of Digital Communication Systems
- Reviews
- Fundamentals of Digital Communication Systems
- Copyright page
- Dedication
- Contents
- Preface
- Acknowledgments
- Notation
- Abbreviations
- 1 Introduction
- 2 Mathematical Preliminaries
- 3 Digital versus Analog Transmission
- 4 Digital Information Sources
- 5 Digital Modulation – Fundamentals
- 6 Single-Carrier Bandpass Transmission
- 7 Spectrum of Digitally Modulated Signals
- 8 Multicarrier Digital Modulation
- 9 Channel Coding
- 10 Topics in Communication System Design
- Further Reading
- Index
4 - Digital Information Sources
Published online by Cambridge University Press: aN Invalid Date NaN
- Fundamentals of Digital Communication Systems
- Reviews
- Fundamentals of Digital Communication Systems
- Copyright page
- Dedication
- Contents
- Preface
- Acknowledgments
- Notation
- Abbreviations
- 1 Introduction
- 2 Mathematical Preliminaries
- 3 Digital versus Analog Transmission
- 4 Digital Information Sources
- 5 Digital Modulation – Fundamentals
- 6 Single-Carrier Bandpass Transmission
- 7 Spectrum of Digitally Modulated Signals
- 8 Multicarrier Digital Modulation
- 9 Channel Coding
- 10 Topics in Communication System Design
- Further Reading
- Index
Summary
This chapter covers digital information sources in some depth. It provides intuition on the information content of a digital source and introduces the notion of redundancy. As a simple but important example, discrete memoryless sources are described. The concept of entropy is defined as a measure of the information content of a digital information source. The properties of entropy are studied, and the source-coding theorem for a discrete memoryless source is given. In the second part of the chapter, practical data compression algorithms are studied. Specifically, Huffman coding, which is an optimal data-compression algorithm when the source statistics are known, and Lempel–Ziv (LZ) and Lempel–Ziv–Welch (LZW) coding schemes, which are universal compression algorithms (not requiring the source statistics), are detailed.
Keywords
- Type
- Chapter
- Information
- Fundamentals of Digital Communication Systems , pp. 138 - 161Publisher: Cambridge University PressPrint publication year: 2025