Natural Scene Statistics Based Blind Image Quality Assessment and Repair PDF Download
Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download Natural Scene Statistics Based Blind Image Quality Assessment and Repair PDF full book. Access full book title Natural Scene Statistics Based Blind Image Quality Assessment and Repair by Anush Krishna Moorthy. Download full books in PDF and EPUB format.
Author: Anush Krishna Moorthy Publisher: ISBN: Category : Languages : en Pages : 408
Book Description
Progress in multimedia technologies has resulted in a plethora of services and devices that capture, compress, transmit and display audiovisual stimuli. Humans -- the ultimate receivers of such stimuli -- now have access to visual entertainment at their homes, their workplaces as well as on mobile devices. With increasing visual signals being received by human observers, in the face of degradations that occur to due the capture, compression and transmission processes, an important aspect of the quality of experience of such stimuli is the \emph{perceived visual quality}. This dissertation focuses on algorithm development for assessing such visual quality of natural images, without need for the `pristine' reference image, i.e., we develop computational models for no-reference image quality assessment (NR IQA). Our NR IQA model stems from the theory that natural images have certain statistical properties that are violated in the presence of degradations, and quantifying such deviations from \emph{naturalness} leads to a blind estimate of quality. The proposed modular and easily extensible framework is distortion-agnostic, in that it does not need to have knowledge of the distortion afflicting the image (contrary to most present-day NR IQA algorithms) and is not only capable of quality assessment with high correlation with human perception, but also is capable of identifying the distortion afflicting the image. This additional distortion-identification, coupled with blind quality assessment leads to a framework that allows for blind general-purpose image repair, which is the second major contribution of this dissertation. The blind general-purpose image repair framework, and its exemplar algorithm described here stem from a revolutionary perspective on image repair, where the framework does not simply attempt to ameliorate the distortion in the image, but to ameliorate the distortion, so that visual quality at the output is maximized. Lastly, this dissertation describes a large-scale human subjective study that was conducted at UT to assess human behavior and opinion on visual quality of videos when viewed on mobile devices. The study lead to a database of 200 distorted videos, which incorporates previously studied distortions such as compression and wireless packet-loss, and also dynamically varying distortions that change as a function of time, such as frame-freezes and temporally varying compression rates. This study -- the first of its kind -- involved over 50 human subjects and resulted in 5,300 summary subjective scores and time-sampled subjective traces of quality for multiple displays. The last part of this dissertation analyzes human behavior and opinion on time-varying video quality, opening up an extremely interesting and relevant field for future research in the area of quality assessment and human behavior.
Author: Anush Krishna Moorthy Publisher: ISBN: Category : Languages : en Pages : 408
Book Description
Progress in multimedia technologies has resulted in a plethora of services and devices that capture, compress, transmit and display audiovisual stimuli. Humans -- the ultimate receivers of such stimuli -- now have access to visual entertainment at their homes, their workplaces as well as on mobile devices. With increasing visual signals being received by human observers, in the face of degradations that occur to due the capture, compression and transmission processes, an important aspect of the quality of experience of such stimuli is the \emph{perceived visual quality}. This dissertation focuses on algorithm development for assessing such visual quality of natural images, without need for the `pristine' reference image, i.e., we develop computational models for no-reference image quality assessment (NR IQA). Our NR IQA model stems from the theory that natural images have certain statistical properties that are violated in the presence of degradations, and quantifying such deviations from \emph{naturalness} leads to a blind estimate of quality. The proposed modular and easily extensible framework is distortion-agnostic, in that it does not need to have knowledge of the distortion afflicting the image (contrary to most present-day NR IQA algorithms) and is not only capable of quality assessment with high correlation with human perception, but also is capable of identifying the distortion afflicting the image. This additional distortion-identification, coupled with blind quality assessment leads to a framework that allows for blind general-purpose image repair, which is the second major contribution of this dissertation. The blind general-purpose image repair framework, and its exemplar algorithm described here stem from a revolutionary perspective on image repair, where the framework does not simply attempt to ameliorate the distortion in the image, but to ameliorate the distortion, so that visual quality at the output is maximized. Lastly, this dissertation describes a large-scale human subjective study that was conducted at UT to assess human behavior and opinion on visual quality of videos when viewed on mobile devices. The study lead to a database of 200 distorted videos, which incorporates previously studied distortions such as compression and wireless packet-loss, and also dynamically varying distortions that change as a function of time, such as frame-freezes and temporally varying compression rates. This study -- the first of its kind -- involved over 50 human subjects and resulted in 5,300 summary subjective scores and time-sampled subjective traces of quality for multiple displays. The last part of this dissertation analyzes human behavior and opinion on time-varying video quality, opening up an extremely interesting and relevant field for future research in the area of quality assessment and human behavior.
Author: Anish Mittal Publisher: ISBN: Category : Languages : en Pages : 100
Book Description
We propose a natural scene statistic based quality assessment model Refer- enceless Image Spatial QUality Evaluator (RISQUE) which extracts marginal statistics of local normalized luminance signals and measures 'un-naturalness' of the distorted image based on measured deviation of them. We also model distribution of pairwise products of adjacent normalized luminance signals providing us with orientation distortion information. Although multi-scale, the model is defined in the space domain avoiding costly frequency or wavelet transforms. The frame work is simple, fast, human perception based and shown to perform statistically better than other proposed no reference algorithms and full reference structural similarity index(SSIM).
Author: Zhou Wang Publisher: Springer Nature ISBN: 3031022386 Category : Technology & Engineering Languages : en Pages : 146
Book Description
This Lecture book is about objective image quality assessment—where the aim is to provide computational models that can automatically predict perceptual image quality. The early years of the 21st century have witnessed a tremendous growth in the use of digital images as a means for representing and communicating information. A considerable percentage of this literature is devoted to methods for improving the appearance of images, or for maintaining the appearance of images that are processed. Nevertheless, the quality of digital images, processed or otherwise, is rarely perfect. Images are subject to distortions during acquisition, compression, transmission, processing, and reproduction. To maintain, control, and enhance the quality of images, it is important for image acquisition, management, communication, and processing systems to be able to identify and quantify image quality degradations. The goals of this book are as follows; a) to introduce the fundamentals of image quality assessment, and to explain the relevant engineering problems, b) to give a broad treatment of the current state-of-the-art in image quality assessment, by describing leading algorithms that address these engineering problems, and c) to provide new directions for future research, by introducing recent models and paradigms that significantly differ from those used in the past. The book is written to be accessible to university students curious about the state-of-the-art of image quality assessment, expert industrial R&D engineers seeking to implement image/video quality assessment systems for specific applications, and academic theorists interested in developing new algorithms for image quality assessment or using existing algorithms to design or optimize other image processing applications.
Author: Anish Mittal Publisher: ISBN: Category : Languages : en Pages : 220
Book Description
With the launch of networked handheld devices which can capture, store, compress, send and display a variety of audiovisual stimuli; high definition television (HDTV); streaming Internet protocol TV (IPTV) and websites such as Youtube, Facebook and Flickr etc., an enormous amount of visual data of visual data is making its way to consumers. Because of this, considerable time and resources are being expanded to ensure that the end user is presented with with a satisfactory quality of experience (QoE). While traditional QoE methods have focused on optimizing delivery networks with respect to throughput, buffer-lengths and capacity, perceptually optimized delivery of multimedia services is also fast gaining importance. This is especially timely given the explosive growth in (especially wireless) video traffic and expected shortfalls in bandwidth. These perceptual approaches attempt to deliver an optimized QoE to the end-user by utilizing objective measures of visual quality. In this thesis, we shall cover a variety of such algorithms that predict overall QoE of an image or a video, depending on the amount of information available for the algorithm design. Typically, quality assessment (QA) algorithms are classiffied on the basis of the amount of information that is available to the algorithm. This thesis will primarily focus on blind QA algorithms, where blind or no-reference (NR) QA refers to automatic quality assessment of an image/video using an algorithm which only utilizes the distorted image/video whose quality is being assessed. NR QA approaches are further classiffied on the basis of whether the algorithm had access to subjective/human opinion prior to deployment. Algorithms which use machine learning techniques along with human judgements of quality during the 'training' phase may be labelled 'opinion aware' algorithms. The first part of the thesis deals with such approaches. While such opinion aware-NR algorithms demonstrate good correlation with human perception on controlled databases, it is impossible to anticipate all of the different distortions that may occur in a practical system and hence train on them. In such cases, it is of interest to design QA algorithms that are not limited in their performance by training data. Approaches which operate without the knowledge of human judgements during the training phase are labelled as 'opinion unaware' (OU) algorithms. We propose such an approach in the second part of the thesis. Further, we propose new VQA algorithms in the last part of the dissertation to address the completely blind VQA problem. The proposed approach quantify disturbances introduced due to distortions and thereby predict the quality of distorted content even without any external knowledge about the pristine natural sources and hence zero shot models.
Author: Ke Gu Publisher: Springer Nature ISBN: 9811933472 Category : Computers Languages : en Pages : 256
Book Description
This book provides readers with a comprehensive review of image quality assessment technology, particularly applications on screen content images, 3D-synthesized images, sonar images, enhanced images, light-field images, VR images, and super-resolution images. It covers topics containing structural variation analysis, sparse reference information, multiscale natural scene statistical analysis, task and visual perception, contour degradation measurement, spatial angular measurement, local and global assessment metrics, and more. All of the image quality assessment algorithms of this book have a high efficiency with better performance compared to other image quality assessment algorithms, and the performance of these approaches mentioned above can be demonstrated by the results of experiments on real-world images. On the basis of this, those interested in relevant fields can use the results obtained through these quality assessment algorithms for further image processing. The goal of this book is to facilitate the use of these image quality assessment algorithms by engineers and scientists from various disciplines, such as optics, electronics, math, photography techniques and computation techniques. The book can serve as a reference for graduate students who are interested in image quality assessment techniques, for front-line researchers practicing these methods, and for domain experts working in this area or conducting related application development.
Author: Michele Antoine Saad Publisher: ISBN: Category : Languages : en Pages : 252
Book Description
We tackle the problems of no-reference/blind image and video quality evaluation. The approach we take is that of modeling the statistical characteristics of natural images and videos, and utilizing deviations from those natural statistics as indicators of perceived quality. We propose a probabilistic model of natural scenes and a probabilistic model of natural videos to drive our image and video quality assessment (I/VQA) algorithms respectively. The VQA problem is considerably different from the IQA problem since it imposes a number of challenges on top of the challenges faced in the IQA problem; namely the challenges arising from the temporal dimension in video that plays an important role in influencing human perception of quality. We compare our IQA approach to the state of the art in blind, reduced reference and full-reference methods, and we show that it is top performing. We compare our VQA approach to the state of the art in reduced and full-reference methods (no blind VQA methods that perform reliably well exist), and show that our algorithm performs as well as the top performing full and reduced reference algorithms in predicting human judgments of quality.
Author: Yuxin Peng Publisher: Springer Nature ISBN: 3030873617 Category : Computers Languages : en Pages : 840
Book Description
This three-volume set LNCS 12888, 12898, and 12890 constitutes the refereed conference proceedings of the 11th International Conference on Image and Graphics, ICIG 2021, held in Haikou, China, in August 2021.* The 198 full papers presented were selected from 421 submissions and focus on advances of theory, techniques and algorithms as well as innovative technologies of image, video and graphics processing and fostering innovation, entrepreneurship, and networking. *The conference was postponed due to the COVID-19 pandemic.
Author: Shailendra Shukla Publisher: Academic Press ISBN: 0323900828 Category : Computers Languages : en Pages : 286
Book Description
Internet of Multimedia Things (IoMT): Techniques and Applications disseminates research efforts in the security and resilience of intelligent data-centric critical systems to support advanced research in this area. Sections cover the background of IoMT Architectures and Technologies, describe the problems that arise in IoMT Computing and protocols, and illustrate the application of IoMT on Industrial applications. The book will be beneficial for engineers, developers, solution designers, architects, system engineers and specialists from professional environments interested in the IoMT to seek appropriate solutions to their specific problems. Addresses recent developments, along with relevant prospects on opportunities and challenges in IoMT Presents the concept and vision of the IoMT, whose potentialities are discussed with speci?c use-cases Discusses the distinct architectural design and characteristics of IoMT as compared to the existing multimedia systems
Author: Anush Krishna Moorthy
Author: Anush Krishna Moorthy
Author: Anish Mittal
Author: Zhou Wang
Author: Anish Mittal
Author: Ke Gu
Author: Di Zhang
Author: M. Michajlovs'kij
Author: Michele Antoine Saad
Author: Yuxin Peng
Author: Shailendra Shukla