Analytic Information Theory: From Compression to Learning

by Michael Drmota and Wojciech Szpankowski

0 ratings • 0 reviews • 0 shelved
Book cover for Analytic Information Theory

Bookhype may earn a small commission from qualifying purchases. Full disclosure.

Through information theory, problems of communication and compression can be precisely modeled, formulated, and analyzed, and this information can be transformed by means of algorithms. Also, learning can be viewed as compression with side information. Aimed at students and researchers, this book addresses data compression and redundancy within existing methods and central topics in theoretical data compression, demonstrating how to use tools from analytic combinatorics to discover and analyze precise behavior of source codes. It shows that to present better learnable or extractable information in its shortest description, one must understand what the information is, and then algorithmically extract it in its most compact form via an efficient compression algorithm. Part I covers fixed-to-variable codes such as Shannon and Huffman codes, variable-to-fixed codes such as Tunstall and Khodak codes, and variable-to-variable Khodak codes for known sources. Part II discusses universal source coding for memoryless, Markov, and renewal sources.
  • ISBN13 9781108474443
  • Publish Date 31 August 2023 (first published 30 August 2023)
  • Publish Status Forthcoming
  • Publish Country GB
  • Imprint Cambridge University Press
  • Format Hardcover
  • Pages 400
  • Language English