Optimization-based Modeling in Investment and Data Science

Optimization-based Modeling in Investment and Data Science PDF Author: Qingyun Sun
Publisher:
ISBN:
Category :
Languages : en
Pages :

Book Description
Optimization has played a key role in numerous fields including data science, statistics, machine learning, decision science, control and quantitative investment. Optimization offers a way for users to focus on the modeling step. Convex optimization has been a very successful and powerful modeling framework. By formulating a problem as convex optimization, practitioners could focus on the modeling side without worrying about designing problem-specific optimization algorithms during prototyping time. However, there are hurdles in applying this convex modeling framework. First, lots of signal processing and machine learning problems are most naturally formulated as non-convex problems. Second, not all convex problems are tractable. Third, it may be hard to encode the knowledge of data into a simple regularizer or constraint and specify the mathematical form of the optimization problem. In this thesis, we talk about topics in optimization-based modeling, including 1) distributional robust Kelly strategy in investment and gambling; 2) convex sparse blind deconvolution; 3) missing data imputation via a new structure called matrix network; 4) neural proximal method for compressive sensing.In these works. I try to expand the boundary of convex optimization based modeling by conquering several hurdles. In the distributional robust Kelly problem, the original distributional robust optimization formulation isconvex but non-tractable; we transform the problem into a tractable form. In the sparse blind deconvolutionproblem, blind deconvolution has been perceived as a non-convex problem for a long time, we proposea scalable convex formulation, and find a phase transition for the convex algorithm. In the missing dataimputation problem, we study a slice-wise missing pattern on tensorial type data that is beyond the capabilityof typical tensor completion algorithms. We propose a new type of underlying low-dimensional structure thatallows us to impute the missing data. In the first three topics, we solve these problems via convex optimizationformulations. In the last topic, we step out of the safety zone of convexity. On the linear inverse problem, we go beyond the sparsity and1−norm regularizer for compressive sensing. To model complex structure innatural/medical images, we propose a learning-based idea to parameterize the proximal map of an unknownregularizer. This idea is inspired by the convex optimization modeling framework and the learning-basedmethod, although the result need not correspond to convex optimization.

Predictive Analytics

Predictive Analytics PDF Author: Vijay Kumar
Publisher: CRC Press
ISBN: 1000332861
Category : Mathematics
Languages : en
Pages : 289

Book Description
Predictive analytics refers to making predictions about the future based on different parameters which are historical data, machine learning, and artificial intelligence. This book provides the most recent advances in the field along with case studies and real-world examples. It discusses predictive modeling and analytics in reliability engineering and introduces current achievements and applications of artificial intelligence, data mining, and other techniques in supply chain management. It covers applications to reliability engineering practice, presents numerous examples to illustrate the theoretical results, and considers and analyses case studies and real-word examples. The book is written for researchers and practitioners in the field of system reliability, quality, supply chain management, and logistics management. Students taking courses in these areas will also find this book of interest.

Optimization-Based Models for Measuring and Hedging Risk in Fixed Income Markets

Optimization-Based Models for Measuring and Hedging Risk in Fixed Income Markets PDF Author: Johan Hagenbjörk
Publisher: Linköping University Electronic Press
ISBN: 917929927X
Category :
Languages : en
Pages : 129

Book Description
The global fixed income market is an enormous financial market whose value by far exceeds that of the public stock markets. The interbank market consists of interest rate derivatives, whose primary purpose is to manage interest rate risk. The credit market primarily consists of the bond market, which links investors to companies, institutions, and governments with borrowing needs. This dissertation takes an optimization perspective upon modeling both these areas of the fixed-income market. Legislators on the national markets require financial actors to value their financial assets in accordance with market prices. Thus, prices of many assets, which are not publicly traded, must be determined mathematically. The financial quantities needed for pricing are not directly observable but must be measured through solving inverse optimization problems. These measurements are based on the available market prices, which are observed with various degrees of measurement noise. For the interbank market, the relevant financial quantities consist of term structures of interest rates, which are curves displaying the market rates for different maturities. For the bond market, credit risk is an additional factor that can be modeled through default intensity curves and term structures of recovery rates in case of default. By formulating suitable optimization models, the different underlying financial quantities can be measured in accordance with observable market prices, while conditions for economic realism are imposed. Measuring and managing risk is closely connected to the measurement of the underlying financial quantities. Through a data-driven method, we can show that six systematic risk factors can be used to explain almost all variance in the interest rate curves. By modeling the dynamics of these six risk factors, possible outcomes can be simulated in the form of term structure scenarios. For short-term simulation horizons, this results in a representation of the portfolio value distribution that is consistent with the realized outcomes from historically observed term structures. This enables more accurate measurements of interest rate risk, where our proposed method exhibits both lower risk and lower pricing errors compared to traditional models. We propose a method for decomposing changes in portfolio values for an arbitrary portfolio into the risk factors that affect the value of each instrument. By demonstrating the method for the six systematic risk factors identified for the interbank market, we show that almost all changes in portfolio value and portfolio variance can be attributed to these risk factors. Additional risk factors and approximation errors are gathered into two terms, which can be studied to ensure the quality of the performance attribution, and possibly improve it. To eliminate undesired risk within trading books, banks use hedging. Traditional methods do not take transaction costs into account. We, therefore, propose a method for managing the risks in the interbank market through a stochastic optimization model that considers transaction costs. This method is based on a scenario approximation of the optimization problem where the six systematic risk factors are simulated, and the portfolio variance is weighted against the transaction costs. This results in a method that is preferred over the traditional methods for all risk-averse investors. For the credit market, we use data from the bond market in combination with the interbank market to make accurate measurements of the financial quantities. We address the notoriously difficult problem of separating default risk from recovery risk. In addition to the previous identified six systematic risk factors for risk-free interests, we identify four risk factors that explain almost all variance in default intensities, while a single risk factor seems sufficient to model the recovery risk. Overall, this is a higher number of risk factors than is usually found in the literature. Through a simple model, we can measure the variance in bond prices in terms of these systematic risk factors, and through performance attribution, we relate these values to the empirically realized variances from the quoted bond prices. De globala ränte- och kreditmarknaderna är enorma finansiella marknader vars sammanlagda värden vida överstiger de publika aktiemarknadernas. Räntemarknaden består av räntederivat vars främsta användningsområde är hantering av ränterisker. Kreditmarknaden utgörs i första hand av obligationsmarknaden som syftar till att förmedla pengar från investerare till företag, institutioner och stater med upplåningsbehov. Denna avhandling fokuserar på att utifrån ett optimeringsperspektiv modellera både ränte- och obligationsmarknaden. Lagstiftarna på de nationella marknaderna kräver att de finansiella aktörerna värderar sina finansiella tillgångar i enlighet med marknadspriser. Därmed måste priserna på många instrument, som inte handlas publikt, beräknas matematiskt. De finansiella storheter som krävs för denna prissättning är inte direkt observerbara, utan måste mätas genom att lösa inversa optimeringsproblem. Dessa mätningar görs utifrån tillgängliga marknadspriser, som observeras med varierande grad av mätbrus. För räntemarknaden utgörs de relevanta finansiella storheterna av räntekurvor som åskådliggör marknadsräntorna för olika löptider. För obligationsmarknaden utgör kreditrisken en ytterligare faktor som modelleras via fallissemangsintensitetskurvor och kurvor kopplade till förväntat återvunnet kapital vid eventuellt fallissemang. Genom att formulera lämpliga optimeringsmodeller kan de olika underliggande finansiella storheterna mätas i enlighet med observerbara marknadspriser samtidigt som ekonomisk realism eftersträvas. Mätning och hantering av risker är nära kopplat till mätningen av de underliggande finansiella storheterna. Genom en datadriven metod kan vi visa att sex systematiska riskfaktorer kan användas för att förklara nästan all varians i räntekurvorna. Genom att modellera dynamiken i dessa sex riskfaktorer kan tänkbara utfall för räntekurvor simuleras. För kortsiktiga simuleringshorisonter resulterar detta i en representation av fördelningen av portföljvärden som väl överensstämmer med de realiserade utfallen från historiskt observerade räntekurvor. Detta möjliggör noggrannare mätningar av ränterisk där vår föreslagna metod uppvisar såväl lägre risk som mindre prissättningsfel jämfört med traditionella modeller. Vi föreslår en metod för att dekomponera portföljutvecklingen för en godtycklig portfölj till de riskfaktorer som påverkar värdet för respektive instrument. Genom att demonstrera metoden för de sex systematiska riskfaktorerna som identifierats för räntemarknaden visar vi att nästan all portföljutveckling och portföljvarians kan härledas till dessa riskfaktorer. Övriga riskfaktorer och approximationsfel samlas i två termer, vilka kan användas för att säkerställa och eventuellt förbättra kvaliteten i prestationshärledningen. För att eliminera oönskad risk i sina tradingböcker använder banker sig av hedging. Traditionella metoder tar ingen hänsyn till transaktionskostnader. Vi föreslår därför en metod för att hantera riskerna på räntemarknaden genom en stokastisk optimeringsmodell som också tar hänsyn till transaktionskostnader. Denna metod bygger på en scenarioapproximation av optimeringsproblemet där de sex systematiska riskfaktorerna simuleras och portföljvariansen vägs mot transaktionskostnaderna. Detta resulterar i en metod som, för alla riskaverta investerare, är att föredra framför de traditionella metoderna. På kreditmarknaden använder vi data från obligationsmarknaden i kombination räntemarknaden för att göra noggranna mätningar av de finansiella storheterna. Vi angriper det erkänt svåra problemet att separera fallissemangsrisk från återvinningsrisk. Förutom de tidigare sex systematiska riskfaktorerna för riskfri ränta, identifierar vi fyra riskfaktorer som förklarar nästan all varians i fallissemangsintensiteter, medan en enda riskfaktor tycks räcka för att modellera återvinningsrisken. Sammanlagt är detta ett större antal riskfaktorer än vad som brukar användas i litteraturen. Via en enkel modell kan vi mäta variansen i obligationspriser i termer av dessa systematiska riskfaktorer och genom prestationshärledningen relatera dessa värden till de empiriskt realiserade varianserna från kvoterade obligationspriser.

Portfolio and Investment Analysis with SAS

Portfolio and Investment Analysis with SAS PDF Author: John B. Guerard
Publisher: SAS Institute
ISBN: 1635266890
Category : Computers
Languages : en
Pages : 277

Book Description
Choose statistically significant stock selection models using SAS® Portfolio and Investment Analysis with SAS®: Financial Modeling Techniques for Optimization is an introduction to using SAS to choose statistically significant stock selection models, create mean-variance efficient portfolios, and aggressively invest to maximize the geometric mean. Based on the pioneering portfolio selection techniques of Harry Markowitz and others, this book shows that maximizing the geometric mean maximizes the utility of final wealth. The authors draw on decades of experience as teachers and practitioners of financial modeling to bridge the gap between theory and application. Using real-world data, the book illustrates the concept of risk-return analysis and explains why intelligent investors prefer stocks over bonds. The authors first explain how to build expected return models based on expected earnings data, valuation ratios, and past stock price performance using PROC ROBUSTREG. They then show how to construct and manage portfolios by combining the expected return and risk models. Finally, readers learn how to perform hypothesis testing using Bayesian methods to add confidence when data mining from large financial databases.

Optimization Modeling with Spreadsheets

Optimization Modeling with Spreadsheets PDF Author: Kenneth R. Baker
Publisher: John Wiley & Sons
ISBN: 1118008979
Category : Business & Economics
Languages : en
Pages : 431

Book Description
Reflects the latest applied research and features state-of-the-art software for building and solving spreadsheet optimization models Thoroughly updated to reflect the latest topical and technical advances in the field, Optimization Modeling with Spreadsheets, Second Edition continues to focus on solving real-world optimization problems through the creation of mathematical models and the use of spreadsheets to represent and analyze those models. Developed and extensively classroom-tested by the author, the book features a systematic approach that equips readers with the skills to apply optimization tools effectively without the need to rely on specialized algorithms. This new edition uses the powerful software package Risk Solver Platform (RSP) for optimization, including its Evolutionary Solver, which employs many recently developed ideas for heuristic programming. The author provides expanded coverage of integer programming and discusses linear and nonlinear programming using a systematic approach that emphasizes the use of spreadsheet-based optimization tools. The Second Edition also features: Classifications for the various problem types, providing the reader with a broad framework for building and recognizing optimization models Network models that allow for a more general form of mass balance A systematic introduction to Data Envelopment Analysis (DEA) The identification of qualitative patterns in order to meaningfully interpret linear programming solutions An introduction to stochastic programming and the use of RSP to solve problems of this type Additional examples, exercises, and cases have been included throughout, allowing readers to test their comprehension of the material. In addition, a related website features Microsoft Office® Excel files to accompany the figures and data sets in the book. With its accessible and comprehensive presentation, Optimization Modeling with Spreadsheets, Second Edition is an excellent book for courses on deterministic models, optimization, and spreadsheet modeling at the upper-undergraduate and graduate levels. The book can also serve as a reference for researchers, practitioners, and consultants working in business, engineering, operations research, and management science.

Advanced Methodologies and Technologies in Business Operations and Management

Advanced Methodologies and Technologies in Business Operations and Management PDF Author: Khosrow-Pour, D.B.A., Mehdi
Publisher: IGI Global
ISBN: 1522573631
Category : Business & Economics
Languages : en
Pages : 1482

Book Description
Businesses consistently work on new projects, products, and workflows to remain competitive and successful in the modern business environment. To remain zealous, businesses must employ the most effective methods and tools in human resources, project management, and overall business plan execution as competitors work to succeed as well. Advanced Methodologies and Technologies in Business Operations and Management provides emerging research on business tools such as employee engagement, payout policies, and financial investing to promote operational success. While highlighting the challenges facing modern organizations, readers will learn how corporate social responsibility and utilizing artificial intelligence improve a company’s culture and management. This book is an ideal resource for executives and managers, researchers, accountants, and financial investors seeking current research on business operations and management.

Portfolio Construction and Analytics

Portfolio Construction and Analytics PDF Author: Frank J. Fabozzi
Publisher: John Wiley & Sons
ISBN: 1118445597
Category : Business & Economics
Languages : en
Pages : 629

Book Description
A detailed, multi-disciplinary approach to investment analytics Portfolio Construction and Analytics provides an up-to-date understanding of the analytic investment process for students and professionals alike. With complete and detailed coverage of portfolio analytics and modeling methods, this book is unique in its multi-disciplinary approach. Investment analytics involves the input of a variety of areas, and this guide provides the perspective of data management, modeling, software resources, and investment strategy to give you a truly comprehensive understanding of how today's firms approach the process. Real-world examples provide insight into analytics performed with vendor software, and references to analytics performed with open source software will prove useful to both students and practitioners. Portfolio analytics refers to all of the methods used to screen, model, track, and evaluate investments. Big data, regulatory change, and increasing risk is forcing a need for a more coherent approach to all aspects of investment analytics, and this book provides the strong foundation and critical skills you need. Master the fundamental modeling concepts and widely used analytics Learn the latest trends in risk metrics, modeling, and investment strategies Get up to speed on the vendor and open-source software most commonly used Gain a multi-angle perspective on portfolio analytics at today's firms Identifying investment opportunities, keeping portfolios aligned with investment objectives, and monitoring risk and performance are all major functions of an investment firm that relies heavily on analytics output. This reliance will only increase in the face of market changes and increased regulatory pressure, and practitioners need a deep understanding of the latest methods and models used to build a robust investment strategy. Portfolio Construction and Analytics is an invaluable resource for portfolio management in any capacity.

Artificial Intelligence in Asset Management

Artificial Intelligence in Asset Management PDF Author: Söhnke M. Bartram
Publisher: CFA Institute Research Foundation
ISBN: 195292703X
Category : Business & Economics
Languages : en
Pages : 95

Book Description
Artificial intelligence (AI) has grown in presence in asset management and has revolutionized the sector in many ways. It has improved portfolio management, trading, and risk management practices by increasing efficiency, accuracy, and compliance. In particular, AI techniques help construct portfolios based on more accurate risk and return forecasts and more complex constraints. Trading algorithms use AI to devise novel trading signals and execute trades with lower transaction costs. AI also improves risk modeling and forecasting by generating insights from new data sources. Finally, robo-advisors owe a large part of their success to AI techniques. Yet the use of AI can also create new risks and challenges, such as those resulting from model opacity, complexity, and reliance on data integrity.

Investment Strategies Optimization based on a SAX-GA Methodology

Investment Strategies Optimization based on a SAX-GA Methodology PDF Author: António M.L. Canelas
Publisher: Springer Science & Business Media
ISBN: 3642331092
Category : Computers
Languages : en
Pages : 90

Book Description
This book presents a new computational finance approach combining a Symbolic Aggregate approximation (SAX) technique with an optimization kernel based on genetic algorithms (GA). While the SAX representation is used to describe the financial time series, the evolutionary optimization kernel is used in order to identify the most relevant patterns and generate investment rules. The proposed approach considers several different chromosomes structures in order to achieve better results on the trading platform The methodology presented in this book has great potential on investment markets.

Proceedings of International Conference on Data Science and Applications

Proceedings of International Conference on Data Science and Applications PDF Author: Mukesh Saraswat
Publisher: Springer Nature
ISBN: 9811651205
Category : Technology & Engineering
Languages : en
Pages : 845

Book Description
This book gathers outstanding papers presented at the International Conference on Data Science and Applications (ICDSA 2021), organized by Soft Computing Research Society (SCRS) and Jadavpur University, Kolkata, India, from April 10 to 11, 2021. It covers theoretical and empirical developments in various areas of big data analytics, big data technologies, decision tree learning, wireless communication, wireless sensor networking, bioinformatics and systems, artificial neural networks, deep learning, genetic algorithms, data mining, fuzzy logic, optimization algorithms, image processing, computational intelligence in civil engineering, and creative computing.