On the Evaluation of Rate Distortion Functions PDF Download

Author: Harry Hu Tan
Publisher:
ISBN:
Category : Rate distortion theory
Languages : en
Pages : 181

View

Book Description
The rate distortion function of a source represents the minimum information rate at which the source can be transmitted to be reproduced within some prescribed average distortion. This function is of considerable interest in source coding and data compression problems. One of the limitations of the usefulness of rate distortion theory is the difficulty in evaluating the rate distortion function for many sources and distortion measures. The research presented in this report is concerned with the evaluation of the rate distortion function for various classes of sources and distortion measures. (Author).

Author: Hoi Ming Leung
Publisher:
ISBN:
Category : Rate distortion theory
Languages : en
Pages : 131

View

Book Description
Contents: Introduction to Rate Distortion Functions; The Rate Distortion Functions with Respect to the Square-Error Criterion of a Memoryless Gaussian Vector Source Whose Components Have Fixed Variances; The Rate Distortion Functions with Respect to the Square-Error Criterion of Spherically Invariant Sources; Rate Distortion Functions of Certain Memoryless Sources with Respect to the Magnitude-Error Criterion; and Bounds to Rate Distortion Functions with Respect to the Magnitude-Error Criterion.

Author: Hoi M. Leung
Publisher:
ISBN:
Category :
Languages : en
Pages : 37

View

Book Description
The evaluation of and bounds for the rate distortion functions of independent and identically distributed (i.i.d.) sources under a magnitude-error criterion were considered. By refining the ingeneous approach of Tan and Yao the rate distortion functions of larger classes of i.i.d. sources were evaluated explicity and the families of lower bounds for arbitrary i.i.d. sources were obtained.

Author: Jerry Gibson
Publisher: Morgan & Claypool Publishers
ISBN: 1598298089
Category : Technology & Engineering
Languages : en
Pages : 129

View

Book Description
This book is very specifically targeted to problems in communications and compression by providing the fundamental principles and results in information theory and rate distortion theory for these applications and presenting methods that have proved and will prove useful in analyzing and designing real systems. The chapters contain treatments of entropy, mutual information, lossless source coding, channel capacity, and rate distortion theory; however, it is the selection, ordering, and presentation of the topics within these broad categories that is unique to this concise book. While the coverage of some standard topics is shortened or eliminated, the standard, but important, topics of the chain rules for entropy and mutual information, relative entropy, the data processing inequality, and the Markov chain condition receive a full treatment. Similarly, lossless source coding techniques presented include the Lempel-Ziv-Welch coding method. The material on rate Distortion theory and exploring fundamental limits on lossy source coding covers the often-neglected Shannon lower bound and the Shannon backward channel condition, rate distortion theory for sources with memory, and the extremely practical topic of rate distortion functions for composite sources. The target audience for the book consists of graduate students at the master's degree level and practicing engineers. It is hoped that practicing engineers can work through this book and comprehend the key results needed to understand the utility of information theory and rate distortion theory and then utilize the results presented to analyze and perhaps improve the communications and compression systems with which they are familiar.

Author: Robert M. Gray
Publisher: Springer Science & Business Media
ISBN: 1441979700
Category : Technology & Engineering
Languages : en
Pages : 430

View

Book Description
This book is an updated version of the information theory classic, first published in 1990. About one-third of the book is devoted to Shannon source and channel coding theorems; the remainder addresses sources, channels, and codes and on information and distortion measures and their properties. New in this edition: Expanded treatment of stationary or sliding-block codes and their relations to traditional block codes Expanded discussion of results from ergodic theory relevant to information theory Expanded treatment of B-processes -- processes formed by stationary coding memoryless sources New material on trading off information and distortion, including the Marton inequality New material on the properties of optimal and asymptotically optimal source codes New material on the relationships of source coding and rate-constrained simulation or modeling of random processes Significant material not covered in other information theory texts includes stationary/sliding-block codes, a geometric view of information theory provided by process distance measures, and general Shannon coding theorems for asymptotic mean stationary sources, which may be neither ergodic nor stationary, and d-bar continuous channels.

Author: Zhenyu Mao
Publisher: Stanford University
ISBN:
Category :
Languages : en
Pages : 159

View

Book Description
Source coding or lossy data compression has been extensively studied ever since Shan- non formally described the problem more than half of a century ago. Yet source coding schemes approaching the theoretical Shannon limit even on simple stationary sources such as IID Gaussian or IID uniform sources remain elusive. In this dissertation, both source coding and the related rate-constrained simulation problem are studied. Four necessary conditions for asymptotically optimal sliding-block or stationary codes for source coding and rate-constrained simulation are derived. The first two necessary conditions are proved for stationary ergodic sources while the remaining two necessary conditions are proved for IID sources. A new code design algorithm which attempts to satisfy all four necessary conditions is presented. The code structure has intuitive similarities to classic random coding arguments as well as to "fake process" methods and alphabet-constrained methods. Experimental results show that the new coding design algorithm provides comparable or superior performance with respect to previously published methods on common IID and autoregressive examples, often by significant margins. In many cases, such as IID Gaussian, IID uniform and discrete IID binary sources, the performance approaches the theoretical Shannon limit.

Author:
Publisher:
ISBN:
Category : Aeronautics
Languages : en
Pages : 960

View

Book Description
Lists citations with abstracts for aerospace related reports obtained from world wide sources and announces documents that have recently been entered into the NASA Scientific and Technical Information Database.

Author: Douglas M. Considine
Publisher: Springer Science & Business Media
ISBN: 1475769180
Category : Technology & Engineering
Languages : en
Pages : 3529

View

Book Description
Advancements in science and engineering have occurred at a surprisingly rapid pace since the release of the seventh edition of this encyclopedia. Large portions of the reference have required comprehensive rewriting and new illustrations. Scores of new topics have been included to create this thoroughly updated eighth edition. The appearance of this new edition in 1994 marks the continuation of a tradition commenced well over a half-century ago in 1938 Van Nostrand's Scientific Encyclopedia, First Edition, was published and welcomed by educators worldwide at a time when what we know today as modern science was just getting underway. The early encyclopedia was well received by students and educators alike during a critical time span when science became established as a major factor in shaping the progress and economy of individual nations and at the global level. A vital need existed for a permanent science reference that could be updated periodically and made conveniently available to audiences that numbered in the millions. The pioneering VNSE met these criteria and continues today as a reliable technical information source for making private and public decisions that present a backdrop of technical alternatives.

Author: Andrew J. Viterbi
Publisher: Courier Corporation
ISBN: 0486318311
Category : Computers
Languages : en
Pages : 578

View

Book Description
Written by two distinguished experts in the field of digital communications, this classic text remains a vital resource three decades after its initial publication. Its treatment is geared toward advanced students of communications theory and to designers of channels, links, terminals, modems, or networks used to transmit and receive digital messages. The three-part approach begins with the fundamentals of digital communication and block coding, including an analysis of block code ensemble performance. The second part introduces convolutional coding, exploring ensemble performance and sequential decoding. The final section addresses source coding and rate distortion theory, examining fundamental concepts for memoryless sources as well as precepts related to memory, Gaussian sources, and universal coding. Appendixes of useful information appear throughout the text, and each chapter concludes with a set of problems, the solutions to which are available online.

Author: Theodore William Benjamin
Publisher:
ISBN:
Category : Algorithms
Languages : en
Pages : 120

View

Book Description