Information Theory: A Concise Introduction

  • 0 Ratings
  • 0 Want to read
  • 0 Currently reading
  • 0 Have read
Not in Library

My Reading Lists:

Create a new list

Check-In

×Close
Add an optional check-in date. Check-in dates are used to track yearly reading goals.
Today

  • 0 Ratings
  • 0 Want to read
  • 0 Currently reading
  • 0 Have read

Buy this book

Last edited by Richard Hollos
December 1, 2015 | History

Information Theory: A Concise Introduction

  • 0 Ratings
  • 0 Want to read
  • 0 Currently reading
  • 0 Have read

Books on information theory tend to fall into one of two extreme categories. There are large academic textbooks that cover the subject with great depth and rigor. Probably the best known of these is the book by Cover and Thomas. At the other extreme are the popular books such as the ones by Pierce and Gleick. They provide a very superficial introduction to the subject, enough to engage in cocktail party conversation but little else. This book attempts to bridge these two extremes.

This book is written for someone who is at least semi-mathematically literate and wants a concise introduction to some of the major concepts in information theory. The level of mathematics needed is very elementary. A rudimentary grasp of logarithms, probability, and basic algebra is all that is required. Two chapters at the end of the book provide a review of everything the reader needs to know about logarithms and discrete probability to get the most out of the book. Very little attention is given to mathematical proof. Instead the results are presented in a way that makes them almost obvious or at least plausible.

The book will appeal to anyone looking for a fast introduction to most of the major topics in information theory. An introduction that is concise but not superficial.

Publish Date
Publisher
Abrazol Publishing
Pages
136

Buy this book

Edition Availability
Cover of: Information Theory: A Concise Introduction
Information Theory: A Concise Introduction
2015, Abrazol Publishing
paperback

Add another edition?

Book Details


Table of Contents

Preface
Introduction
Number guessing game
Counterfeit coins
Encoding Messages
Nonuniform probabilities
Kraft-McMillan inequality
Average code word length
Huffman Coding
Arithmetic Coding
Entropy
Entropy of a Markov Chain
Principle of maximum entropy
Entropy of English
Channel Capacity
Channel capacity and gambling
Error Correction Coding
Repetition codes
Parity check codes
Hamming codes
Supplementary Material
Review of logarithms
Review of Discrete Probability
References and Further Reading
Acknowledgements
About the Authors

Edition Notes

Published in
Longmont, USA

The Physical Object

Format
paperback
Number of pages
136
Dimensions
8.5 x 5.5 x 0.375 inches

ID Numbers

Open Library
OL25875155M
ISBN 13
9781887187282
LCCN
2015907737

Community Reviews (0)

Feedback?
No community reviews have been submitted for this work.

Lists

This work does not appear on any lists.

History

Download catalog record: RDF / JSON / OPDS | Wikipedia citation
December 1, 2015 Edited by Richard Hollos Added new cover
December 1, 2015 Edited by Richard Hollos Added another author, publisher, contents, description, pages.
December 1, 2015 Created by Richard Hollos Added new book.