Active Learning and Uncertainty in Graph-Based Semi-Supervised Learning PDF Download
Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download Active Learning and Uncertainty in Graph-Based Semi-Supervised Learning PDF full book. Access full book title Active Learning and Uncertainty in Graph-Based Semi-Supervised Learning by Kevin Miller. Download full books in PDF and EPUB format.
Author: Kevin Miller Publisher: ISBN: Category : Languages : en Pages : 189
Book Description
We present various results and methods for measuring uncertainty and applying active learning to graph-based semi-supervised learning, as well as a graph-dependent result for generalization of decentralized federated learning. The first piece of work presents an analysis of graph-based semi-supervised learning in the framework of Bayesian inverse problems; we prove posterior consistency of the corresponding Bayesian posterior distribution under a clustering model that accounts for overlap between clusters. The second and third pieces of work introduce and apply a graph-based method for selecting informative points for use in active learning. We present a computationally efficient framework for this active learning method and present empirical results on both hyperspectral and synthetic aperture radar datasets. The final piece of work provides an analysis of graph structure dependent generalization guarantees for decentralized federated learning. Through both theoretical analysis and empirical results, we demonstrate that expander graphs are in a sense optimally efficient for balancing communication cost as well as mixing properties of the associated graph.
Author: Kevin Miller Publisher: ISBN: Category : Languages : en Pages : 189
Book Description
We present various results and methods for measuring uncertainty and applying active learning to graph-based semi-supervised learning, as well as a graph-dependent result for generalization of decentralized federated learning. The first piece of work presents an analysis of graph-based semi-supervised learning in the framework of Bayesian inverse problems; we prove posterior consistency of the corresponding Bayesian posterior distribution under a clustering model that accounts for overlap between clusters. The second and third pieces of work introduce and apply a graph-based method for selecting informative points for use in active learning. We present a computationally efficient framework for this active learning method and present empirical results on both hyperspectral and synthetic aperture radar datasets. The final piece of work provides an analysis of graph structure dependent generalization guarantees for decentralized federated learning. Through both theoretical analysis and empirical results, we demonstrate that expander graphs are in a sense optimally efficient for balancing communication cost as well as mixing properties of the associated graph.
Author: XIYANG LUO Publisher: ISBN: Category : Languages : en Pages : 109
Book Description
In recent years, the need for pattern recognition and data analysis has grown exponentially in various fields of scientific research. My research is centered around graph Laplacian based techniques for image processing and machine learning. Three papers pertaining to this theme will be presented in this thesis.The first work is an application of graph Laplacian regularization to the problem of convolutional sparse coding. The additional regularization improves the robustness of the sparse representation with respect to noise, and has empirically shown to improve the performance of denoising on several well-known images. Efficient algorithms for computing the eigen-decomposition of the graph Laplacian were also incorporated to the solver for fast implementations of the method.The second piece of work studies the convergence of the graph Allen-Cahn scheme. A technique inspired by the maximum principle for the heat equation is used to show stability of the convex-splitting numeric scheme. This coupled with techniques from convex optimization allows for a proof of convergence under an a-posteriori condition. The analysis is then generalized to handle spectral trunction, a common method to save computational cost, and also to the case of multi-class classification. In particular, the results for spectral trunction are drastically different from that of the original scheme in the worst case, but does not present itself in practical applications.The third piece of work combines two fields of research, uncertainty quantification, and semi-supervised learning on graphs. The work presents a unified Bayesian framework thatincorporates most previous methods for graph-based semi-supervised learning. A Bayesianframework allows for the computation of uncertainty for certain quantities under the pos-terior distribution. We show via solid numerical evidence that for a few carefully designedquantities, the expectations computed under the posterior yields meaningful notions of un-certainty for the classification problem. Efficient numerical methods were also devised tomake possible the evaluation of these quantities for large scale graphs.
Author: Burr Chen Publisher: Springer Nature ISBN: 3031015606 Category : Computers Languages : en Pages : 100
Book Description
The key idea behind active learning is that a machine learning algorithm can perform better with less training if it is allowed to choose the data from which it learns. An active learner may pose "queries," usually in the form of unlabeled data instances to be labeled by an "oracle" (e.g., a human annotator) that already understands the nature of the problem. This sort of approach is well-motivated in many modern machine learning and data mining applications, where unlabeled data may be abundant or easy to come by, but training labels are difficult, time-consuming, or expensive to obtain. This book is a general introduction to active learning. It outlines several scenarios in which queries might be formulated, and details many query selection algorithms which have been organized into four broad categories, or "query selection frameworks." We also touch on some of the theoretical foundations of active learning, and conclude with an overview of the strengths and weaknesses of these approaches in practice, including a summary of ongoing work to address these open challenges and opportunities. Table of Contents: Automating Inquiry / Uncertainty Sampling / Searching Through the Hypothesis Space / Minimizing Expected Error and Variance / Exploiting Structure in Data / Theory / Practical Considerations
Author: Xiaojin Geffner Publisher: Springer Nature ISBN: 3031015487 Category : Computers Languages : en Pages : 116
Book Description
Semi-supervised learning is a learning paradigm concerned with the study of how computers and natural systems such as humans learn in the presence of both labeled and unlabeled data. Traditionally, learning has been studied either in the unsupervised paradigm (e.g., clustering, outlier detection) where all the data are unlabeled, or in the supervised paradigm (e.g., classification, regression) where all the data are labeled. The goal of semi-supervised learning is to understand how combining labeled and unlabeled data may change the learning behavior, and design algorithms that take advantage of such a combination. Semi-supervised learning is of great interest in machine learning and data mining because it can use readily available unlabeled data to improve supervised learning tasks when the labeled data are scarce or expensive. Semi-supervised learning also shows potential as a quantitative tool to understand human category learning, where most of the input is self-evidently unlabeled. In this introductory book, we present some popular semi-supervised learning models, including self-training, mixture models, co-training and multiview learning, graph-based methods, and semi-supervised support vector machines. For each model, we discuss its basic mathematical formulation. The success of semi-supervised learning depends critically on some underlying assumptions. We emphasize the assumptions made by each model and give counterexamples when appropriate to demonstrate the limitations of the different models. In addition, we discuss semi-supervised learning for cognitive psychology. Finally, we give a computational learning theoretic perspective on semi-supervised learning, and we conclude the book with a brief discussion of open questions in the field. Table of Contents: Introduction to Statistical Machine Learning / Overview of Semi-Supervised Learning / Mixture Models and EM / Co-Training / Graph-Based Semi-Supervised Learning / Semi-Supervised Support Vector Machines / Human Semi-Supervised Learning / Theory and Outlook
Author: Hao Li Publisher: ISBN: Category : Languages : en Pages : 148
Book Description
We present several results on the subject of graph-based semi-supervised learning and a novel application of network analysis to analyzing complex spatiotemporal data. The first piece of work showcases a specific graph-based semi-supervised learning algorithm in the application to ego-activity classification in body-worn video. The classification method is inspired by three interrelated processes: the Allen-Cahn equation, the Merriman-Bence-Osher scheme, and mean curvature flow. We present results on real-world body-worn videos and demonstrate our method's comparable performance to supervised methods. The second piece of work presents semi-supervised learning problem in the framework of Bayesian inverse problems; we prove posterior consistency and elucidate how hyperparameter choices in the Bayesian model combine to affect the contraction rates of the posterior. The third piece of work presents a method of uncertainty quantification in the aforementioned framework; we also develop the foundations for a system with a human in the loop who serves to provide additional class labels based on the uncertainty quantification. The fourth piece of work further extends the Bayesian inverse problem framework to the active learning problem. We introduce an adaptation of non-Gaussian Bayesian models to allow efficient calculations previously done only on Gaussian models and a novel way of choosing new training data. The last piece of work presents a multivariate point-process model that infers latent relationships from complex spatiotemporal data.
Author: Monica Bianchini Publisher: Springer Science & Business Media ISBN: 3642366570 Category : Technology & Engineering Languages : en Pages : 547
Book Description
This handbook presents some of the most recent topics in neural information processing, covering both theoretical concepts and practical applications. The contributions include: Deep architectures Recurrent, recursive, and graph neural networks Cellular neural networks Bayesian networks Approximation capabilities of neural networks Semi-supervised learning Statistical relational learning Kernel methods for structured data Multiple classifier systems Self organisation and modal learning Applications to content-based image retrieval, text mining in large document collections, and bioinformatics This book is thought particularly for graduate students, researchers and practitioners, willing to deepen their knowledge on more advanced connectionist models and related learning paradigms.
Author: Linwei Wang Publisher: Springer Nature ISBN: 3031164318 Category : Computers Languages : en Pages : 796
Book Description
The eight-volume set LNCS 13431, 13432, 13433, 13434, 13435, 13436, 13437, and 13438 constitutes the refereed proceedings of the 25th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2022, which was held in Singapore in September 2022. The 574 revised full papers presented were carefully reviewed and selected from 1831 submissions in a double-blind review process. The papers are organized in the following topical sections: Part I: Brain development and atlases; DWI and tractography; functional brain networks; neuroimaging; heart and lung imaging; dermatology; Part II: Computational (integrative) pathology; computational anatomy and physiology; ophthalmology; fetal imaging; Part III: Breast imaging; colonoscopy; computer aided diagnosis; Part IV: Microscopic image analysis; positron emission tomography; ultrasound imaging; video data analysis; image segmentation I; Part V: Image segmentation II; integration of imaging with non-imaging biomarkers; Part VI: Image registration; image reconstruction; Part VII: Image-Guided interventions and surgery; outcome and disease prediction; surgical data science; surgical planning and simulation; machine learning – domain adaptation and generalization; Part VIII: Machine learning – weakly-supervised learning; machine learning – model interpretation; machine learning – uncertainty; machine learning theory and methodologies.
Author: Xizhao Wang Publisher: CRC Press ISBN: 1315353563 Category : Business & Economics Languages : en Pages : 195
Book Description
Learning with uncertainty covers a broad range of scenarios in machine learning, this book mainly focuses on: (1) Decision tree learning with uncertainty, (2) Clustering under uncertainty environment, (3) Active learning based on uncertainty criterion, and (4) Ensemble learning in a framework of uncertainty. The book starts with the introduction to uncertainty including randomness, roughness, fuzziness and non-specificity and then comprehensively discusses a number of key issues in learning with uncertainty, such as uncertainty representation in learning, the influence of uncertainty on the performance of learning system, the heuristic design with uncertainty, etc. Most contents of the book are our research results in recent decades. The purpose of this book is to help the readers to understand the impact of uncertainty on learning processes. It comes with many examples to facilitate understanding. The book can be used as reference book or textbook for researcher fellows, senior undergraduates and postgraduates majored in computer science and technology, applied mathematics, automation, electrical engineering, etc.
Author: Olivier Chapelle Publisher: MIT Press ISBN: 0262514125 Category : Computers Languages : en Pages : 525
Book Description
A comprehensive review of an area of machine learning that deals with the use of unlabeled data in classification problems: state-of-the-art algorithms, a taxonomy of the field, applications, benchmark experiments, and directions for future research. In the field of machine learning, semi-supervised learning (SSL) occupies the middle ground, between supervised learning (in which all training examples are labeled) and unsupervised learning (in which no label data are given). Interest in SSL has increased in recent years, particularly because of application domains in which unlabeled data are plentiful, such as images, text, and bioinformatics. This first comprehensive overview of SSL presents state-of-the-art algorithms, a taxonomy of the field, selected applications, benchmark experiments, and perspectives on ongoing and future research.Semi-Supervised Learning first presents the key assumptions and ideas underlying the field: smoothness, cluster or low-density separation, manifold structure, and transduction. The core of the book is the presentation of SSL methods, organized according to algorithmic strategies. After an examination of generative models, the book describes algorithms that implement the low-density separation assumption, graph-based methods, and algorithms that perform two-step learning. The book then discusses SSL applications and offers guidelines for SSL practitioners by analyzing the results of extensive benchmark experiments. Finally, the book looks at interesting directions for SSL research. The book closes with a discussion of the relationship between semi-supervised learning and transduction.
Author: Kevin Miller
Author: Kevin Miller
Author: XIYANG LUO
Author: Burr Chen
Author: Xiaojin Geffner
Author: Hao Li
Author: Monica Bianchini
Author: Yi Liu
Author: Linwei Wang
Author: Xizhao Wang
Author: Olivier Chapelle