Rate Distortion Functions for Discrete Sources with Continuous Reproductions PDF Download

Author: Theodore William Benjamin
Publisher:
ISBN:
Category : Algorithms
Languages : en
Pages : 120

View

Book Description

Author: Robert M. Gray
Publisher: Springer Science & Business Media
ISBN: 1441979700
Category : Technology & Engineering
Languages : en
Pages : 430

View

Book Description
This book is an updated version of the information theory classic, first published in 1990. About one-third of the book is devoted to Shannon source and channel coding theorems; the remainder addresses sources, channels, and codes and on information and distortion measures and their properties. New in this edition: Expanded treatment of stationary or sliding-block codes and their relations to traditional block codes Expanded discussion of results from ergodic theory relevant to information theory Expanded treatment of B-processes -- processes formed by stationary coding memoryless sources New material on trading off information and distortion, including the Marton inequality New material on the properties of optimal and asymptotically optimal source codes New material on the relationships of source coding and rate-constrained simulation or modeling of random processes Significant material not covered in other information theory texts includes stationary/sliding-block codes, a geometric view of information theory provided by process distance measures, and general Shannon coding theorems for asymptotic mean stationary sources, which may be neither ergodic nor stationary, and d-bar continuous channels.

Author: Jan C. A. Lubbe
Publisher: Cambridge University Press
ISBN: 9780521467605
Category : Computers
Languages : en
Pages : 366

View

Book Description
We live in the information society. The main aim of this book is to describe the basic ideas of information theory, answering questions such as how may we transmit and store information as compactly as possible, what is the maximum quantity of information that can be transmitted by a particular channel or network, and how can security be assured? It covers all the basic ideas of information theory and sets them in the context of current applications. These include Shannon's information measure, discrete and continuous information sources and information channels with or without memory, source and channel decoding, rate distortion theory, error correcting codes and the information theoretical approach to cryptology. Throughout the book special attention has been paid to multiterminal or network information theory. This text will be of use to advanced undergraduates and graduate students in electrical engineering and computer science.

Author: Milan Velebit
Publisher:
ISBN:
Category :
Languages : en
Pages : 174

View

Book Description

Author: Wade H. Shafer
Publisher: Springer Science & Business Media
ISBN: 1468426044
Category : Science
Languages : en
Pages : 300

View

Book Description
Masters Theses in the Pure and Applied Sciences was first conceived, published, and disseminated by TPRC at Purdue University in 1957, starting its coverage of theses with the academic year 1955. Beginning with Volume 13, the printing and dissemina tion phases of the activity was transferred to University Microfilms/Xerox of Ann Arbor, Michigan, with the thought that such an arrangement would be more beneficial to the academic and general scientific and technical community. After five years of this joint undertaking we have concluded that it will be in the interest of all concerned if the printing and distribution of the volume were handled by a well-known publishing house to assure improved service and better communication. Hence, effective with this Volume 18, Masters Theses in the Pure and Applied Sciences will be disseminated on a worldwide basis by Plenum Publishing Corporation of New York. All back issues can also be ordered from Plenum. As we embark on this new partnership with Plenum, we also initiate a new venture in that this important annual reference work now covers Canadian universities as well as those in the United States. We are sure that this broader base will greatly enhance the value of these volumes.

Author: Heather A. Harrington
Publisher: American Mathematical Soc.
ISBN: 1470423219
Category : Mathematics
Languages : en
Pages : 290

View

Book Description
This volume contains the proceedings of the AMS Special Session on Algebraic and Geometric Methods in Applied Discrete Mathematics, held on January 11, 2015, in San Antonio, Texas. The papers present connections between techniques from “pure” mathematics and various applications amenable to the analysis of discrete models, encompassing applications of combinatorics, topology, algebra, geometry, optimization, and representation theory. Papers not only present novel results, but also survey the current state of knowledge of important topics in applied discrete mathematics. Particular highlights include: a new computational framework, based on geometric combinatorics, for structure prediction from RNA sequences; a new method for approximating the optimal solution of a sum of squares problem; a survey of recent Helly-type geometric theorems; applications of representation theory to voting theory and game theory; a study of fixed points of tensors; and exponential random graph models from the perspective of algebraic statistics with applications to networks. This volume was written for those trained in areas such as algebra, topology, geometry, and combinatorics who are interested in tackling problems in fields such as biology, the social sciences, data analysis, and optimization. It may be useful not only for experts, but also for students who wish to gain an applied or interdisciplinary perspective.

Author: Norbert Goertz
Publisher: World Scientific
ISBN: 1860948456
Category : Computers
Languages : en
Pages : 207

View

Book Description
This book provides the first comprehensive and easy-to-read discussion of joint source-channel encoding and decoding for source signals with continuous amplitudes. It is a state-of-the-art presentation of this exciting, thriving field of research, making pioneering contributions to the new concept of source-adaptive modulation.The book starts with the basic theory and the motivation for a joint realization of source and channel coding. Specialized chapters deal with practically relevant scenarios such as iterative source-channel decoding and its optimization for a given encoder, and also improved encoder designs by channel-adaptive quantization or source-adaptive modulation.Although Information Theory is not the main topic of the book ? in fact, the concept of joint source-channel coding is contradictory to the classical system design motivated by a questionable practical interpretation of the separation theorem ? this theory still provides the ultimate performance limits for any practical system, whether it uses joint source-channel coding or not. Therefore, the theoretical limits are presented in a self-contained appendix, which is a useful reference also for those not directly interested in the main topic of this book.

Author:
Publisher:
ISBN:
Category : Electric circuits
Languages : en
Pages : 1016

View

Book Description

Author: Zhenyu Mao
Publisher: Stanford University
ISBN:
Category :
Languages : en
Pages : 159

View

Book Description
Source coding or lossy data compression has been extensively studied ever since Shan- non formally described the problem more than half of a century ago. Yet source coding schemes approaching the theoretical Shannon limit even on simple stationary sources such as IID Gaussian or IID uniform sources remain elusive. In this dissertation, both source coding and the related rate-constrained simulation problem are studied. Four necessary conditions for asymptotically optimal sliding-block or stationary codes for source coding and rate-constrained simulation are derived. The first two necessary conditions are proved for stationary ergodic sources while the remaining two necessary conditions are proved for IID sources. A new code design algorithm which attempts to satisfy all four necessary conditions is presented. The code structure has intuitive similarities to classic random coding arguments as well as to "fake process" methods and alphabet-constrained methods. Experimental results show that the new coding design algorithm provides comparable or superior performance with respect to previously published methods on common IID and autoregressive examples, often by significant margins. In many cases, such as IID Gaussian, IID uniform and discrete IID binary sources, the performance approaches the theoretical Shannon limit.

Author: Harry Hu Tan
Publisher:
ISBN:
Category : Rate distortion theory
Languages : en
Pages : 181

View

Book Description
The rate distortion function of a source represents the minimum information rate at which the source can be transmitted to be reproduced within some prescribed average distortion. This function is of considerable interest in source coding and data compression problems. One of the limitations of the usefulness of rate distortion theory is the difficulty in evaluating the rate distortion function for many sources and distortion measures. The research presented in this report is concerned with the evaluation of the rate distortion function for various classes of sources and distortion measures. (Author).