Perturbed Semi-Markov Type Processes I PDF Download
Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download Perturbed Semi-Markov Type Processes I PDF full book. Access full book title Perturbed Semi-Markov Type Processes I by Dmitrii Silvestrov. Download full books in PDF and EPUB format.
Author: Dmitrii Silvestrov Publisher: Springer Nature ISBN: 3030924033 Category : Mathematics Languages : en Pages : 406
Book Description
This book is the first volume of a two-volume monograph devoted to the study of limit and ergodic theorems for regularly and singularly perturbed Markov chains, semi-Markov processes, and multi-alternating regenerative processes with semi-Markov modulation. The first volume presents necessary and sufficient conditions for weak convergence for first-rare-event times and convergence in the topology J for first-rare-event processes defined on regularly perturbed finite Markov chains and semi-Markov processes. The text introduces new asymptotic recurrent algorithms of phase space reduction. It also addresses both effective conditions of weak convergence for distributions of hitting times as well as convergence of expectations of hitting times for regularly and singularly perturbed finite Markov chains and semi-Markov processes. The book also contains a comprehensive bibliography of major works in the field. It provides an effective reference for both graduate students as well as theoretical and applied researchers studying stochastic processes and their applications.
Author: Dmitrii Silvestrov Publisher: Springer Nature ISBN: 3030924033 Category : Mathematics Languages : en Pages : 406
Book Description
This book is the first volume of a two-volume monograph devoted to the study of limit and ergodic theorems for regularly and singularly perturbed Markov chains, semi-Markov processes, and multi-alternating regenerative processes with semi-Markov modulation. The first volume presents necessary and sufficient conditions for weak convergence for first-rare-event times and convergence in the topology J for first-rare-event processes defined on regularly perturbed finite Markov chains and semi-Markov processes. The text introduces new asymptotic recurrent algorithms of phase space reduction. It also addresses both effective conditions of weak convergence for distributions of hitting times as well as convergence of expectations of hitting times for regularly and singularly perturbed finite Markov chains and semi-Markov processes. The book also contains a comprehensive bibliography of major works in the field. It provides an effective reference for both graduate students as well as theoretical and applied researchers studying stochastic processes and their applications.
Author: Dmitrii Silvestrov Publisher: Springer Nature ISBN: 3030923991 Category : Mathematics Languages : en Pages : 420
Book Description
This book is the second volume of a two-volume monograph devoted to the study of limit and ergodic theorems for regularly and singularly perturbed Markov chains, semi-Markov processes, and multi-alternating regenerative processes with semi-Markov modulation. The second volume presents a complete classification of ergodic theorems for alternating regenerative processes, including more than twenty-five such theorems. The text addresses new asymptotic recurrent algorithms of phase space reduction for multi-alternating regenerative processes modulating by regularly and singularly perturbed finite semi-Markov processes. It also features a new study of super-long, long, and short time ergodic theorems for these processes. The book also contains a comprehensive bibliography of major works in the field. It provides an effective reference for both graduate students as well as theoretical and applied researchers studying stochastic processes and their applications.
Author: Dmitrii Silvestrov Publisher: Springer ISBN: 3319609882 Category : Mathematics Languages : en Pages : 151
Book Description
The book presents new methods of asymptotic analysis for nonlinearly perturbed semi-Markov processes with a finite phase space. These methods are based on special time-space screening procedures for sequential phase space reduction of semi-Markov processes combined with the systematical use of operational calculus for Laurent asymptotic expansions. Effective recurrent algorithms are composed for getting asymptotic expansions, without and with explicit upper bounds for remainders, for power moments of hitting times, stationary and conditional quasi-stationary distributions for nonlinearly perturbed semi-Markov processes. These results are illustrated by asymptotic expansions for birth-death-type semi-Markov processes, which play an important role in various applications. The book will be a useful contribution to the continuing intensive studies in the area. It is an essential reference for theoretical and applied researchers in the field of stochastic processes and their applications that will contribute to continuing extensive studies in the area and remain relevant for years to come.
Author: Sergei Silvestrov Publisher: Springer ISBN: 3030028259 Category : Mathematics Languages : en Pages : 475
Book Description
This book highlights the latest advances in stochastic processes, probability theory, mathematical statistics, engineering mathematics and algebraic structures, focusing on mathematical models, structures, concepts, problems and computational methods and algorithms important in modern technology, engineering and natural sciences applications. It comprises selected, high-quality, refereed contributions from various large research communities in modern stochastic processes, algebraic structures and their interplay and applications. The chapters cover both theory and applications, illustrated by numerous figures, schemes, algorithms, tables and research results to help readers understand the material and develop new mathematical methods, concepts and computing applications in the future. Presenting new methods and results, reviews of cutting-edge research, and open problems and directions for future research, the book serves as a source of inspiration for a broad spectrum of researchers and research students in probability theory and mathematical statistics, applied algebraic structures, applied mathematics and other areas of mathematics and applications of mathematics. The book is based on selected contributions presented at the International Conference on “Stochastic Processes and Algebraic Structures – From Theory Towards Applications” (SPAS2017) to mark Professor Dmitrii Silvestrov’s 70th birthday and his 50 years of fruitful service to mathematics, education and international cooperation, which was held at Mälardalen University in Västerås and Stockholm University, Sweden, in October 2017.
Author: Franciszek Grabski Publisher: Elsevier ISBN: 0128006595 Category : Mathematics Languages : en Pages : 270
Book Description
Semi-Markov Processes: Applications in System Reliability and Maintenance is a modern view of discrete state space and continuous time semi-Markov processes and their applications in reliability and maintenance. The book explains how to construct semi-Markov models and discusses the different reliability parameters and characteristics that can be obtained from those models. The book is a useful resource for mathematicians, engineering practitioners, and PhD and MSc students who want to understand the basic concepts and results of semi-Markov process theory. Clearly defines the properties and theorems from discrete state Semi-Markov Process (SMP) theory Describes the method behind constructing Semi-Markov (SM) models and SM decision models in the field of reliability and maintenance Provides numerous individual versions of SM models, including the most recent and their impact on system reliability and maintenance
Author: Mats Gyllenberg Publisher: Walter de Gruyter ISBN: 3110208253 Category : Mathematics Languages : en Pages : 593
Book Description
The book is devoted to studies of quasi-stationary phenomena in nonlinearly perturbed stochastic systems. New methods of asymptotic analysis for nonlinearly perturbed stochastic processes based on new types of asymptotic expansions for perturbed renewal equation and recurrence algorithms for construction of asymptotic expansions for Markov type processes with absorption are presented. Asymptotic expansions are given in mixed ergodic (for processes) and large deviation theorems (for absorption times) for nonlinearly perturbed regenerative processes, semi-Markov processes, and Markov chains. Applications to analysis of quasi-stationary phenomena in nonlinearly perturbed queueing systems, population dynamics and epidemic models, and for risk processes are presented. The book also contains an extended bibliography of works in the area. It is an essential reference for theoretical and applied researchers in the field of stochastic processes and their applications and may be also useful for doctoral and advanced undergraduate students.
Author: N. Limnios Publisher: Springer Science & Business Media ISBN: 1461201616 Category : Technology & Engineering Languages : en Pages : 226
Book Description
At first there was the Markov property. The theory of stochastic processes, which can be considered as an exten sion of probability theory, allows the modeling of the evolution of systems through the time. It cannot be properly understood just as pure mathemat ics, separated from the body of experience and examples that have brought it to life. The theory of stochastic processes entered a period of intensive develop ment, which is not finished yet, when the idea of the Markov property was brought in. Not even a serious study of the renewal processes is possible without using the strong tool of Markov processes. The modern theory of Markov processes has its origins in the studies by A. A: Markov (1856-1922) of sequences of experiments "connected in a chain" and in the attempts to describe mathematically the physical phenomenon known as Brownian mo tion. Later, many generalizations (in fact all kinds of weakenings of the Markov property) of Markov type stochastic processes were proposed. Some of them have led to new classes of stochastic processes and useful applications. Let us mention some of them: systems with complete connections [90, 91, 45, 86]; K-dependent Markov processes [44]; semi-Markov processes, and so forth. The semi-Markov processes generalize the renewal processes as well as the Markov jump processes and have numerous applications, especially in relia bility.
Author: George G. Yin Publisher: Springer ISBN: 1461206278 Category : Mathematics Languages : en Pages : 358
Book Description
Using a singular perturbation approach, this is a systematic treatment of those systems that naturally arise in queuing theory, control and optimisation, and manufacturing, gathering a number of ideas which were previously scattered throughout the literature. The book presents results on asymptotic expansions of the corresponding probability distributions, functional occupation measures, exponential upper bounds, and asymptotic normality. To bridge the gap between theory and applications, a large portion of the book is devoted to various applications, thus reducing the dimensionality for problems under Markovian disturbances and providing tools for dealing with large-scale and complex real-world situations. Much of this stems from the authors'recent research, presenting results which have not appeared elsewhere. An important reference for researchers in applied mathematics, probability and stochastic processes, operations research, control theory, and optimisation.
Author: Boris Harlamov Publisher: John Wiley & Sons ISBN: 111862405X Category : Mathematics Languages : en Pages : 313
Book Description
This title considers the special of random processes known as semi-Markov processes. These possess the Markov property with respect to any intrinsic Markov time such as the first exit time from an open set or a finite iteration of these times. The class of semi-Markov processes includes strong Markov processes, Lévy and Smith stepped semi-Markov processes, and some other subclasses. Extensive coverage is devoted to non-Markovian semi-Markov processes with continuous trajectories and, in particular, to semi-Markov diffusion processes. Readers looking to enrich their knowledge on Markov processes will find this book a valuable resource.
Author: Paul J. Schweitzer Publisher: ISBN: Category : Markov processes Languages : en Pages : 315
Book Description
The Howard-Jewell algorithm for programming over a Markov-renewal process is analyzed in terms of a perturbation theory formalism which describes how the stationary distribution changes when the transition probabilities change. The policy improvement technique is derived from this new viewpoint. The relative values may be interpreted as partial derivatives of the gain rate with respect to policy. The value equations are shown to be solvable, with the relative values unique up to one additive constant, if and only if the underlying Markov chain is irreducible. The policy iteration algorithm is shown not to cycle, this guaranteeing convergence. A discussion of the existence, uniqueness, and characterization of the solution to the functional equation of dynamic programming is given. Emphasis is placed upon the value maximization of transient states. The fundamental matrix is developed as a useful tool for doing perturbation theory, describing firstpassage properties of semi-Markov processes, and for dealing with semi-Markov processes with rewards. (Author).