Introduction to Derivative-Free Optimization PDF Download

Author: Andrew R. Conn
Publisher: SIAM
ISBN: 0898716683
Category : Mathematics
Languages : en
Pages : 276

View

Book Description
The first contemporary comprehensive treatment of optimization without derivatives. This text explains how sampling and model techniques are used in derivative-free methods and how they are designed to solve optimization problems. It is designed to be readily accessible to both researchers and those with a modest background in computational mathematics.

Author: Charles Audet
Publisher: Springer
ISBN: 3319689134
Category : Mathematics
Languages : en
Pages : 302

View

Book Description
This book is designed as a textbook, suitable for self-learning or for teaching an upper-year university course on derivative-free and blackbox optimization. The book is split into 5 parts and is designed to be modular; any individual part depends only on the material in Part I. Part I of the book discusses what is meant by Derivative-Free and Blackbox Optimization, provides background material, and early basics while Part II focuses on heuristic methods (Genetic Algorithms and Nelder-Mead). Part III presents direct search methods (Generalized Pattern Search and Mesh Adaptive Direct Search) and Part IV focuses on model-based methods (Simplex Gradient and Trust Region). Part V discusses dealing with constraints, using surrogates, and bi-objective optimization. End of chapter exercises are included throughout as well as 15 end of chapter projects and over 40 figures. Benchmarking techniques are also presented in the appendix.

Author: Andrew R. Conn
Publisher: SIAM
ISBN: 0898718767
Category : Mathematics
Languages : en
Pages : 277

View

Book Description
The absence of derivatives, often combined with the presence of noise or lack of smoothness, is a major challenge for optimisation. This book explains how sampling and model techniques are used in derivative-free methods and how these methods are designed to efficiently and rigorously solve optimisation problems.

Author: Slawomir Koziel
Publisher: Springer
ISBN: 3642208592
Category : Technology & Engineering
Languages : en
Pages : 292

View

Book Description
Computational optimization is an important paradigm with a wide range of applications. In virtually all branches of engineering and industry, we almost always try to optimize something - whether to minimize the cost and energy consumption, or to maximize profits, outputs, performance and efficiency. In many cases, this search for optimality is challenging, either because of the high computational cost of evaluating objectives and constraints, or because of the nonlinearity, multimodality, discontinuity and uncertainty of the problem functions in the real-world systems. Another complication is that most problems are often NP-hard, that is, the solution time for finding the optimum increases exponentially with the problem size. The development of efficient algorithms and specialized techniques that address these difficulties is of primary importance for contemporary engineering, science and industry. This book consists of 12 self-contained chapters, contributed from worldwide experts who are working in these exciting areas. The book strives to review and discuss the latest developments concerning optimization and modelling with a focus on methods and algorithms for computational optimization. It also covers well-chosen, real-world applications in science, engineering and industry. Main topics include derivative-free optimization, multi-objective evolutionary algorithms, surrogate-based methods, maximum simulated likelihood estimation, support vector machines, and metaheuristic algorithms. Application case studies include aerodynamic shape optimization, microwave engineering, black-box optimization, classification, economics, inventory optimization and structural optimization. This graduate level book can serve as an excellent reference for lecturers, researchers and students in computational science, engineering and industry.

Author: Yaroslav D. Sergeyev
Publisher: Springer
ISBN: 1493971999
Category : Computers
Languages : en
Pages : 136

View

Book Description
This book begins with a concentrated introduction into deterministic global optimization and moves forward to present new original results from the authors who are well known experts in the field. Multiextremal continuous problems that have an unknown structure with Lipschitz objective functions and functions having the first Lipschitz derivatives defined over hyperintervals are examined. A class of algorithms using several Lipschitz constants is introduced which has its origins in the DIRECT (DIviding RECTangles) method. This new class is based on an efficient strategy that is applied for the search domain partitioning. In addition a survey on derivative free methods and methods using the first derivatives is given for both one-dimensional and multi-dimensional cases. Non-smooth and smooth minorants and acceleration techniques that can speed up several classes of global optimization methods with examples of applications and problems arising in numerical testing of global optimization algorithms are discussed. Theoretical considerations are illustrated through engineering applications. Extensive numerical testing of algorithms described in this book stretches the likelihood of establishing a link between mathematicians and practitioners. The authors conclude by describing applications and a generator of random classes of test functions with known local and global minima that is used in more than 40 countries of the world. This title serves as a starting point for students, researchers, engineers, and other professionals in operations research, management science, computer science, engineering, economics, environmental sciences, industrial and applied mathematics to obtain an overview of deterministic global optimization.

Author: Yaroslav D. Sergeyev
Publisher: Springer Science & Business Media
ISBN: 1461480426
Category : Mathematics
Languages : en
Pages : 135

View

Book Description
Introduction to Global Optimization Exploiting Space-Filling Curves provides an overview of classical and new results pertaining to the usage of space-filling curves in global optimization. The authors look at a family of derivative-free numerical algorithms applying space-filling curves to reduce the dimensionality of the global optimization problem; along with a number of unconventional ideas, such as adaptive strategies for estimating Lipschitz constant, balancing global and local information to accelerate the search. Convergence conditions of the described algorithms are studied in depth and theoretical considerations are illustrated through numerical examples. This work also contains a code for implementing space-filling curves that can be used for constructing new global optimization algorithms. Basic ideas from this text can be applied to a number of problems including problems with multiextremal and partially defined constraints and non-redundant parallel computations can be organized. Professors, students, researchers, engineers, and other professionals in the fields of pure mathematics, nonlinear sciences studying fractals, operations research, management science, industrial and applied mathematics, computer science, engineering, economics, and the environmental sciences will find this title useful . ​

Author: Jorge Nocedal
Publisher: Springer Science & Business Media
ISBN: 0387400656
Category : Mathematics
Languages : en
Pages : 686

View

Book Description
Optimization is an important tool used in decision science and for the analysis of physical systems used in engineering. One can trace its roots to the Calculus of Variations and the work of Euler and Lagrange. This natural and reasonable approach to mathematical programming covers numerical methods for finite-dimensional optimization problems. It begins with very simple ideas progressing through more complicated concepts, concentrating on methods for both unconstrained and constrained optimization.

Author: Andreas Griewank
Publisher: SIAM
ISBN: 0898716594
Category : Mathematics
Languages : en
Pages : 448

View

Book Description
This title is a comprehensive treatment of algorithmic, or automatic, differentiation. The second edition covers recent developments in applications and theory, including an elegant NP completeness argument and an introduction to scarcity.

Author: Richard P. Brent
Publisher: Courier Corporation
ISBN: 0486143686
Category : Mathematics
Languages : en
Pages : 210

View

Book Description
DIVOutstanding text for graduate students and research workers proposes improvements to existing algorithms, extends their related mathematical theories, and offers details on new algorithms for approximating local and global minima. /div

Author: Joaquim R. R. A. Martins
Publisher: Cambridge University Press
ISBN: 110898861X
Category : Mathematics
Languages : en
Pages : 653

View

Book Description
Based on course-tested material, this rigorous yet accessible graduate textbook covers both fundamental and advanced optimization theory and algorithms. It covers a wide range of numerical methods and topics, including both gradient-based and gradient-free algorithms, multidisciplinary design optimization, and uncertainty, with instruction on how to determine which algorithm should be used for a given application. It also provides an overview of models and how to prepare them for use with numerical optimization, including derivative computation. Over 400 high-quality visualizations and numerous examples facilitate understanding of the theory, and practical tips address common issues encountered in practical engineering design optimization and how to address them. Numerous end-of-chapter homework problems, progressing in difficulty, help put knowledge into practice. Accompanied online by a solutions manual for instructors and source code for problems, this is ideal for a one- or two-semester graduate course on optimization in aerospace, civil, mechanical, electrical, and chemical engineering departments.