Author: Bradley EfronPublisher:
ISBN:
Category :
Languages : en
Pages : 22
Book Description
Large-scale Simultaneous Hypothesis Testing
Author: Bradley EfronLarge-Scale Inference
Author: Bradley EfronPublisher: Cambridge University Press
ISBN: 1139492136
Category : Mathematics
Languages : en
Pages :
Book Description
We live in a new age for statistical inference, where modern scientific technology such as microarrays and fMRI machines routinely produce thousands and sometimes millions of parallel data sets, each with its own estimation or testing problem. Doing thousands of problems at once is more than repeated application of classical methods. Taking an empirical Bayes approach, Bradley Efron, inventor of the bootstrap, shows how information accrues across problems in a way that combines Bayesian and frequentist ideas. Estimation, testing and prediction blend in this framework, producing opportunities for new methodologies of increased power. New difficulties also arise, easily leading to flawed inferences. This book takes a careful look at both the promise and pitfalls of large-scale statistical inference, with particular attention to false discovery rates, the most successful of the new statistical techniques. Emphasis is on the inferential ideas underlying technical developments, illustrated using a large number of real examples.
Large-scale Multiple Hypothesis Testing with Complex Data Structure
Author: Xiaoyu DaiPublisher:
ISBN:
Category : Electronic dissertations
Languages : en
Pages : 104
Book Description
In the last decade, motivated by a variety of applications in medicine, bioinformatics, genomics, brain imaging, etc., a growing amount of statistical research has been devoted to large-scale multiple testing, where thousands or even greater numbers of tests are conducted simultaneously. However, due to the complexity of real data sets, the assumptions of many existing multiple testing procedures, e.g. that tests are independent and have continuous null distributions of p-values, may not hold. This poses limitations in their performances such as low detection power and inflated false discovery rate (FDR). In this dissertation, we study how to better proceed the multiple testing problems under complex data structures. In Chapter 2, we study the multiple testing with discrete test statistics. In Chapter 3, we study the discrete multiple testing with prior ordering information incorporated. In Chapter 4, we study the multiple testing under complex dependency structure. We propose novel procedures under each scenario, based on the marginal critical functions (MCFs) of randomized tests, the conditional random field (CRF) or the deep neural network (DNN). The theoretical properties of our procedures are carefully studied, and their performances are evaluated through various simulations and real applications with the analysis of genetic data from next-generation sequencing (NGS) experiments.
Simultaneous Statistical Inference
Author: Thorsten DickhausPublisher: Springer Science & Business Media
ISBN: 3642451829
Category : Science
Languages : en
Pages : 182
Book Description
This monograph will provide an in-depth mathematical treatment of modern multiple test procedures controlling the false discovery rate (FDR) and related error measures, particularly addressing applications to fields such as genetics, proteomics, neuroscience and general biology. The book will also include a detailed description how to implement these methods in practice. Moreover new developments focusing on non-standard assumptions are also included, especially multiple tests for discrete data. The book primarily addresses researchers and practitioners but will also be beneficial for graduate students.
Resampling-Based Multiple Testing
Author: Peter H. WestfallPublisher: John Wiley & Sons
ISBN: 9780471557616
Category : Mathematics
Languages : en
Pages : 382
Book Description
Combines recent developments in resampling technology (including the bootstrap) with new methods for multiple testing that are easy to use, convenient to report and widely applicable. Software from SAS Institute is available to execute many of the methods and programming is straightforward for other applications. Explains how to summarize results using adjusted p-values which do not necessitate cumbersome table look-ups. Demonstrates how to incorporate logical constraints among hypotheses, further improving power.
Global Testing and Large-Scale Multiple Testing for High-Dimensional Covariance Structures
Author: Tony CaiPublisher:
ISBN:
Category :
Languages : en
Pages :
Book Description
Driven by a wide range of contemporary applications, statistical inference for covariance structures has been an active area of current research in high-dimensional statistics. This review provides a selective survey of some recent developments in hypothesis testing for high-dimensional covariance structures, including global testing for the overall pattern of the covariance structures and simultaneous testing of a large collection of hypotheses on the local covariance structures with false discovery proportion and false discovery rate control. Both one-sample and two-sample settings are considered. The specific testing problems discussed include global testing for the covariance, correlation, and precision matrices, and multiple testing for the correlations, Gaussian graphical models, and differential networks.
Multiple Testing Procedures Controlling False Discovery Rate with Applications to Genomic Data
Author: Iris Mirales GauranPublisher:
ISBN:
Category :
Languages : en
Pages : 320
Book Description
In recent mutation studies, analyses based on protein domain positions are gaining popularity over traditional gene-centric approaches since the latter have limitations in considering the functional context that the position of the mutation provides. This presents a large-scale simultaneous inference problem, with hundreds of hypothesis tests to consider at the same time. The overarching objective of this thesis is to propose different multiple testing procedures which can address the problems posed by discrete genomic data. Specifically, we are interested in identifying significant mutation counts while controlling a given level of Type I error via False Discovery Rate (FDR) procedures. One main assumption is that the mutation counts follow a zero-inflated model in order to account for the true zeros in the count model and the excess zeros. The class of models considered is the Zero-inflated Generalized Poisson (ZIGP) distribution.
Analysis of Error Control in Large Scale Two-stage Multiple Hypothesis Testing
Author: Wenge GuoStatistical Methods for Large-scale Multiple Testing Problems
Author: Yu GaoPublisher:
ISBN:
Category : Genetics
Languages : en
Pages : 100
Book Description
A large-scale multiple testing problem simultaneously tests thousands or even millions of null hypotheses, and it is widely used in different fields, for example genetics and astronomy. An error rate serves as a measure of the performance of a testing procedure. The use of the family-wise error rate can accommodate any dependence between hypotheses, but it is often overly conservative and has limited detection power.The false discovery rate is more powerful, however not as widely used due to the requirement of independence and other reasons. In this thesis, we develop statistical methods for large-scale multiple testing problems in pharmacovigilance and genetic studies, and adopt the false discovery rate to improve the detection power by tacking mixed challenges.
Concentration of Maxima and Fundamental Limits in High-Dimensional Testing and Inference
Author: Zheng GaoPublisher: Springer Nature
ISBN: 3030809641
Category : Mathematics
Languages : en
Pages : 147
Book Description
This book provides a unified exposition of some fundamental theoretical problems in high-dimensional statistics. It specifically considers the canonical problems of detection and support estimation for sparse signals observed with noise. Novel phase-transition results are obtained for the signal support estimation problem under a variety of statistical risks. Based on a surprising connection to a concentration of maxima probabilistic phenomenon, the authors obtain a complete characterization of the exact support recovery problem for thresholding estimators under dependent errors.