Author: Daniel S. Levine
Publisher: Psychology Press
ISBN: 1134771541
Category : Psychology
Languages : en
Pages : 523
Book Description
The second published collection based on a conference sponsored by the Metroplex Institute for Neural Dynamics -- the first is Motivation, Emotion, and Goal Direction in Neural Networks (LEA, 1992) -- this book addresses the controversy between symbolicist artificial intelligence and neural network theory. A particular issue is how well neural networks -- well established for statistical pattern matching -- can perform the higher cognitive functions that are more often associated with symbolic approaches. This controversy has a long history, but recently erupted with arguments against the abilities of renewed neural network developments. More broadly than other attempts, the diverse contributions presented here not only address the theory and implementation of artificial neural networks for higher cognitive functions, but also critique the history of assumed epistemologies -- both neural networks and AI -- and include several neurobiological studies of human cognition as a real system to guide the further development of artificial ones. Organized into four major sections, this volume: * outlines the history of the AI/neural network controversy, the strengths and weaknesses of both approaches, and shows the various capabilities such as generalization and discreetness as being along a broad but common continuum; * introduces several explicit, theoretical structures demonstrating the functional equivalences of neurocomputing with the staple objects of computer science and AI, such as sets and graphs; * shows variants on these types of networks that are applied in a variety of spheres, including reasoning from a geographic database, legal decision making, story comprehension, and performing arithmetic operations; * discusses knowledge representation process in living organisms, including evidence from experimental psychology, behavioral neurobiology, and electroencephalographic responses to sensory stimuli.
Neural Networks for Knowledge Representation and Inference
Author: Daniel S. Levine
Publisher: Psychology Press
ISBN: 1134771541
Category : Psychology
Languages : en
Pages : 523
Book Description
The second published collection based on a conference sponsored by the Metroplex Institute for Neural Dynamics -- the first is Motivation, Emotion, and Goal Direction in Neural Networks (LEA, 1992) -- this book addresses the controversy between symbolicist artificial intelligence and neural network theory. A particular issue is how well neural networks -- well established for statistical pattern matching -- can perform the higher cognitive functions that are more often associated with symbolic approaches. This controversy has a long history, but recently erupted with arguments against the abilities of renewed neural network developments. More broadly than other attempts, the diverse contributions presented here not only address the theory and implementation of artificial neural networks for higher cognitive functions, but also critique the history of assumed epistemologies -- both neural networks and AI -- and include several neurobiological studies of human cognition as a real system to guide the further development of artificial ones. Organized into four major sections, this volume: * outlines the history of the AI/neural network controversy, the strengths and weaknesses of both approaches, and shows the various capabilities such as generalization and discreetness as being along a broad but common continuum; * introduces several explicit, theoretical structures demonstrating the functional equivalences of neurocomputing with the staple objects of computer science and AI, such as sets and graphs; * shows variants on these types of networks that are applied in a variety of spheres, including reasoning from a geographic database, legal decision making, story comprehension, and performing arithmetic operations; * discusses knowledge representation process in living organisms, including evidence from experimental psychology, behavioral neurobiology, and electroencephalographic responses to sensory stimuli.
Publisher: Psychology Press
ISBN: 1134771541
Category : Psychology
Languages : en
Pages : 523
Book Description
The second published collection based on a conference sponsored by the Metroplex Institute for Neural Dynamics -- the first is Motivation, Emotion, and Goal Direction in Neural Networks (LEA, 1992) -- this book addresses the controversy between symbolicist artificial intelligence and neural network theory. A particular issue is how well neural networks -- well established for statistical pattern matching -- can perform the higher cognitive functions that are more often associated with symbolic approaches. This controversy has a long history, but recently erupted with arguments against the abilities of renewed neural network developments. More broadly than other attempts, the diverse contributions presented here not only address the theory and implementation of artificial neural networks for higher cognitive functions, but also critique the history of assumed epistemologies -- both neural networks and AI -- and include several neurobiological studies of human cognition as a real system to guide the further development of artificial ones. Organized into four major sections, this volume: * outlines the history of the AI/neural network controversy, the strengths and weaknesses of both approaches, and shows the various capabilities such as generalization and discreetness as being along a broad but common continuum; * introduces several explicit, theoretical structures demonstrating the functional equivalences of neurocomputing with the staple objects of computer science and AI, such as sets and graphs; * shows variants on these types of networks that are applied in a variety of spheres, including reasoning from a geographic database, legal decision making, story comprehension, and performing arithmetic operations; * discusses knowledge representation process in living organisms, including evidence from experimental psychology, behavioral neurobiology, and electroencephalographic responses to sensory stimuli.
Neural Networks for Knowledge Representation and Inference
Author: Daniel S. Levine
Publisher: Psychology Press
ISBN: 1134771614
Category : Psychology
Languages : en
Pages : 526
Book Description
The second published collection based on a conference sponsored by the Metroplex Institute for Neural Dynamics -- the first is Motivation, Emotion, and Goal Direction in Neural Networks (LEA, 1992) -- this book addresses the controversy between symbolicist artificial intelligence and neural network theory. A particular issue is how well neural networks -- well established for statistical pattern matching -- can perform the higher cognitive functions that are more often associated with symbolic approaches. This controversy has a long history, but recently erupted with arguments against the abilities of renewed neural network developments. More broadly than other attempts, the diverse contributions presented here not only address the theory and implementation of artificial neural networks for higher cognitive functions, but also critique the history of assumed epistemologies -- both neural networks and AI -- and include several neurobiological studies of human cognition as a real system to guide the further development of artificial ones. Organized into four major sections, this volume: * outlines the history of the AI/neural network controversy, the strengths and weaknesses of both approaches, and shows the various capabilities such as generalization and discreetness as being along a broad but common continuum; * introduces several explicit, theoretical structures demonstrating the functional equivalences of neurocomputing with the staple objects of computer science and AI, such as sets and graphs; * shows variants on these types of networks that are applied in a variety of spheres, including reasoning from a geographic database, legal decision making, story comprehension, and performing arithmetic operations; * discusses knowledge representation process in living organisms, including evidence from experimental psychology, behavioral neurobiology, and electroencephalographic responses to sensory stimuli.
Publisher: Psychology Press
ISBN: 1134771614
Category : Psychology
Languages : en
Pages : 526
Book Description
The second published collection based on a conference sponsored by the Metroplex Institute for Neural Dynamics -- the first is Motivation, Emotion, and Goal Direction in Neural Networks (LEA, 1992) -- this book addresses the controversy between symbolicist artificial intelligence and neural network theory. A particular issue is how well neural networks -- well established for statistical pattern matching -- can perform the higher cognitive functions that are more often associated with symbolic approaches. This controversy has a long history, but recently erupted with arguments against the abilities of renewed neural network developments. More broadly than other attempts, the diverse contributions presented here not only address the theory and implementation of artificial neural networks for higher cognitive functions, but also critique the history of assumed epistemologies -- both neural networks and AI -- and include several neurobiological studies of human cognition as a real system to guide the further development of artificial ones. Organized into four major sections, this volume: * outlines the history of the AI/neural network controversy, the strengths and weaknesses of both approaches, and shows the various capabilities such as generalization and discreetness as being along a broad but common continuum; * introduces several explicit, theoretical structures demonstrating the functional equivalences of neurocomputing with the staple objects of computer science and AI, such as sets and graphs; * shows variants on these types of networks that are applied in a variety of spheres, including reasoning from a geographic database, legal decision making, story comprehension, and performing arithmetic operations; * discusses knowledge representation process in living organisms, including evidence from experimental psychology, behavioral neurobiology, and electroencephalographic responses to sensory stimuli.
Knowledge Graphs for eXplainable Artificial Intelligence: Foundations, Applications and Challenges
Author: I. Tiddi
Publisher: IOS Press
ISBN: 1643680811
Category : Computers
Languages : en
Pages : 314
Book Description
The latest advances in Artificial Intelligence and (deep) Machine Learning in particular revealed a major drawback of modern intelligent systems, namely the inability to explain their decisions in a way that humans can easily understand. While eXplainable AI rapidly became an active area of research in response to this need for improved understandability and trustworthiness, the field of Knowledge Representation and Reasoning (KRR) has on the other hand a long-standing tradition in managing information in a symbolic, human-understandable form. This book provides the first comprehensive collection of research contributions on the role of knowledge graphs for eXplainable AI (KG4XAI), and the papers included here present academic and industrial research focused on the theory, methods and implementations of AI systems that use structured knowledge to generate reliable explanations. Introductory material on knowledge graphs is included for those readers with only a minimal background in the field, as well as specific chapters devoted to advanced methods, applications and case-studies that use knowledge graphs as a part of knowledge-based, explainable systems (KBX-systems). The final chapters explore current challenges and future research directions in the area of knowledge graphs for eXplainable AI. The book not only provides a scholarly, state-of-the-art overview of research in this subject area, but also fosters the hybrid combination of symbolic and subsymbolic AI methods, and will be of interest to all those working in the field.
Publisher: IOS Press
ISBN: 1643680811
Category : Computers
Languages : en
Pages : 314
Book Description
The latest advances in Artificial Intelligence and (deep) Machine Learning in particular revealed a major drawback of modern intelligent systems, namely the inability to explain their decisions in a way that humans can easily understand. While eXplainable AI rapidly became an active area of research in response to this need for improved understandability and trustworthiness, the field of Knowledge Representation and Reasoning (KRR) has on the other hand a long-standing tradition in managing information in a symbolic, human-understandable form. This book provides the first comprehensive collection of research contributions on the role of knowledge graphs for eXplainable AI (KG4XAI), and the papers included here present academic and industrial research focused on the theory, methods and implementations of AI systems that use structured knowledge to generate reliable explanations. Introductory material on knowledge graphs is included for those readers with only a minimal background in the field, as well as specific chapters devoted to advanced methods, applications and case-studies that use knowledge graphs as a part of knowledge-based, explainable systems (KBX-systems). The final chapters explore current challenges and future research directions in the area of knowledge graphs for eXplainable AI. The book not only provides a scholarly, state-of-the-art overview of research in this subject area, but also fosters the hybrid combination of symbolic and subsymbolic AI methods, and will be of interest to all those working in the field.
Representation Learning for Natural Language Processing
Author: Zhiyuan Liu
Publisher: Springer Nature
ISBN: 9811555737
Category : Computers
Languages : en
Pages : 319
Book Description
This open access book provides an overview of the recent advances in representation learning theory, algorithms and applications for natural language processing (NLP). It is divided into three parts. Part I presents the representation learning techniques for multiple language entries, including words, phrases, sentences and documents. Part II then introduces the representation techniques for those objects that are closely related to NLP, including entity-based world knowledge, sememe-based linguistic knowledge, networks, and cross-modal entries. Lastly, Part III provides open resource tools for representation learning techniques, and discusses the remaining challenges and future research directions. The theories and algorithms of representation learning presented can also benefit other related domains such as machine learning, social network analysis, semantic Web, information retrieval, data mining and computational biology. This book is intended for advanced undergraduate and graduate students, post-doctoral fellows, researchers, lecturers, and industrial engineers, as well as anyone interested in representation learning and natural language processing.
Publisher: Springer Nature
ISBN: 9811555737
Category : Computers
Languages : en
Pages : 319
Book Description
This open access book provides an overview of the recent advances in representation learning theory, algorithms and applications for natural language processing (NLP). It is divided into three parts. Part I presents the representation learning techniques for multiple language entries, including words, phrases, sentences and documents. Part II then introduces the representation techniques for those objects that are closely related to NLP, including entity-based world knowledge, sememe-based linguistic knowledge, networks, and cross-modal entries. Lastly, Part III provides open resource tools for representation learning techniques, and discusses the remaining challenges and future research directions. The theories and algorithms of representation learning presented can also benefit other related domains such as machine learning, social network analysis, semantic Web, information retrieval, data mining and computational biology. This book is intended for advanced undergraduate and graduate students, post-doctoral fellows, researchers, lecturers, and industrial engineers, as well as anyone interested in representation learning and natural language processing.
Time-Space, Spiking Neural Networks and Brain-Inspired Artificial Intelligence
Author: Nikola K. Kasabov
Publisher: Springer
ISBN: 3662577151
Category : Technology & Engineering
Languages : en
Pages : 742
Book Description
Spiking neural networks (SNN) are biologically inspired computational models that represent and process information internally as trains of spikes. This monograph book presents the classical theory and applications of SNN, including original author’s contribution to the area. The book introduces for the first time not only deep learning and deep knowledge representation in the human brain and in brain-inspired SNN, but takes that further to develop new types of AI systems, called in the book brain-inspired AI (BI-AI). BI-AI systems are illustrated on: cognitive brain data, including EEG, fMRI and DTI; audio-visual data; brain-computer interfaces; personalized modelling in bio-neuroinformatics; multisensory streaming data modelling in finance, environment and ecology; data compression; neuromorphic hardware implementation. Future directions, such as the integration of multiple modalities, such as quantum-, molecular- and brain information processing, is presented in the last chapter. The book is a research book for postgraduate students, researchers and practitioners across wider areas, including computer and information sciences, engineering, applied mathematics, bio- and neurosciences.
Publisher: Springer
ISBN: 3662577151
Category : Technology & Engineering
Languages : en
Pages : 742
Book Description
Spiking neural networks (SNN) are biologically inspired computational models that represent and process information internally as trains of spikes. This monograph book presents the classical theory and applications of SNN, including original author’s contribution to the area. The book introduces for the first time not only deep learning and deep knowledge representation in the human brain and in brain-inspired SNN, but takes that further to develop new types of AI systems, called in the book brain-inspired AI (BI-AI). BI-AI systems are illustrated on: cognitive brain data, including EEG, fMRI and DTI; audio-visual data; brain-computer interfaces; personalized modelling in bio-neuroinformatics; multisensory streaming data modelling in finance, environment and ecology; data compression; neuromorphic hardware implementation. Future directions, such as the integration of multiple modalities, such as quantum-, molecular- and brain information processing, is presented in the last chapter. The book is a research book for postgraduate students, researchers and practitioners across wider areas, including computer and information sciences, engineering, applied mathematics, bio- and neurosciences.
The Alignment Problem: Machine Learning and Human Values
Author: Brian Christian
Publisher: W. W. Norton & Company
ISBN: 039363583X
Category : Science
Languages : en
Pages : 459
Book Description
A jaw-dropping exploration of everything that goes wrong when we build AI systems and the movement to fix them. Today’s “machine-learning” systems, trained by data, are so effective that we’ve invited them to see and hear for us—and to make decisions on our behalf. But alarm bells are ringing. Recent years have seen an eruption of concern as the field of machine learning advances. When the systems we attempt to teach will not, in the end, do what we want or what we expect, ethical and potentially existential risks emerge. Researchers call this the alignment problem. Systems cull résumés until, years later, we discover that they have inherent gender biases. Algorithms decide bail and parole—and appear to assess Black and White defendants differently. We can no longer assume that our mortgage application, or even our medical tests, will be seen by human eyes. And as autonomous vehicles share our streets, we are increasingly putting our lives in their hands. The mathematical and computational models driving these changes range in complexity from something that can fit on a spreadsheet to a complex system that might credibly be called “artificial intelligence.” They are steadily replacing both human judgment and explicitly programmed software. In best-selling author Brian Christian’s riveting account, we meet the alignment problem’s “first-responders,” and learn their ambitious plan to solve it before our hands are completely off the wheel. In a masterful blend of history and on-the ground reporting, Christian traces the explosive growth in the field of machine learning and surveys its current, sprawling frontier. Readers encounter a discipline finding its legs amid exhilarating and sometimes terrifying progress. Whether they—and we—succeed or fail in solving the alignment problem will be a defining human story. The Alignment Problem offers an unflinching reckoning with humanity’s biases and blind spots, our own unstated assumptions and often contradictory goals. A dazzlingly interdisciplinary work, it takes a hard look not only at our technology but at our culture—and finds a story by turns harrowing and hopeful.
Publisher: W. W. Norton & Company
ISBN: 039363583X
Category : Science
Languages : en
Pages : 459
Book Description
A jaw-dropping exploration of everything that goes wrong when we build AI systems and the movement to fix them. Today’s “machine-learning” systems, trained by data, are so effective that we’ve invited them to see and hear for us—and to make decisions on our behalf. But alarm bells are ringing. Recent years have seen an eruption of concern as the field of machine learning advances. When the systems we attempt to teach will not, in the end, do what we want or what we expect, ethical and potentially existential risks emerge. Researchers call this the alignment problem. Systems cull résumés until, years later, we discover that they have inherent gender biases. Algorithms decide bail and parole—and appear to assess Black and White defendants differently. We can no longer assume that our mortgage application, or even our medical tests, will be seen by human eyes. And as autonomous vehicles share our streets, we are increasingly putting our lives in their hands. The mathematical and computational models driving these changes range in complexity from something that can fit on a spreadsheet to a complex system that might credibly be called “artificial intelligence.” They are steadily replacing both human judgment and explicitly programmed software. In best-selling author Brian Christian’s riveting account, we meet the alignment problem’s “first-responders,” and learn their ambitious plan to solve it before our hands are completely off the wheel. In a masterful blend of history and on-the ground reporting, Christian traces the explosive growth in the field of machine learning and surveys its current, sprawling frontier. Readers encounter a discipline finding its legs amid exhilarating and sometimes terrifying progress. Whether they—and we—succeed or fail in solving the alignment problem will be a defining human story. The Alignment Problem offers an unflinching reckoning with humanity’s biases and blind spots, our own unstated assumptions and often contradictory goals. A dazzlingly interdisciplinary work, it takes a hard look not only at our technology but at our culture—and finds a story by turns harrowing and hopeful.
Handbook of Knowledge Representation
Author: Frank van Harmelen
Publisher: Elsevier
ISBN: 0080557023
Category : Computers
Languages : en
Pages : 1035
Book Description
Handbook of Knowledge Representation describes the essential foundations of Knowledge Representation, which lies at the core of Artificial Intelligence (AI). The book provides an up-to-date review of twenty-five key topics in knowledge representation, written by the leaders of each field. It includes a tutorial background and cutting-edge developments, as well as applications of Knowledge Representation in a variety of AI systems. This handbook is organized into three parts. Part I deals with general methods in Knowledge Representation and reasoning and covers such topics as classical logic in Knowledge Representation; satisfiability solvers; description logics; constraint programming; conceptual graphs; nonmonotonic reasoning; model-based problem solving; and Bayesian networks. Part II focuses on classes of knowledge and specialized representations, with chapters on temporal representation and reasoning; spatial and physical reasoning; reasoning about knowledge and belief; temporal action logics; and nonmonotonic causal logic. Part III discusses Knowledge Representation in applications such as question answering; the semantic web; automated planning; cognitive robotics; multi-agent systems; and knowledge engineering. This book is an essential resource for graduate students, researchers, and practitioners in knowledge representation and AI. * Make your computer smarter* Handle qualitative and uncertain information* Improve computational tractability to solve your problems easily
Publisher: Elsevier
ISBN: 0080557023
Category : Computers
Languages : en
Pages : 1035
Book Description
Handbook of Knowledge Representation describes the essential foundations of Knowledge Representation, which lies at the core of Artificial Intelligence (AI). The book provides an up-to-date review of twenty-five key topics in knowledge representation, written by the leaders of each field. It includes a tutorial background and cutting-edge developments, as well as applications of Knowledge Representation in a variety of AI systems. This handbook is organized into three parts. Part I deals with general methods in Knowledge Representation and reasoning and covers such topics as classical logic in Knowledge Representation; satisfiability solvers; description logics; constraint programming; conceptual graphs; nonmonotonic reasoning; model-based problem solving; and Bayesian networks. Part II focuses on classes of knowledge and specialized representations, with chapters on temporal representation and reasoning; spatial and physical reasoning; reasoning about knowledge and belief; temporal action logics; and nonmonotonic causal logic. Part III discusses Knowledge Representation in applications such as question answering; the semantic web; automated planning; cognitive robotics; multi-agent systems; and knowledge engineering. This book is an essential resource for graduate students, researchers, and practitioners in knowledge representation and AI. * Make your computer smarter* Handle qualitative and uncertain information* Improve computational tractability to solve your problems easily
Building Large Knowledge-based Systems
Author: Douglas B. Lenat
Publisher: Addison Wesley Publishing Company
ISBN:
Category : Computers
Languages : en
Pages : 408
Book Description
Chapter one presents the Cyc "philosophy" or paradigm. Chapter 2 presents a global overview of Cyc, including its representation language, the ontology f its knowledge base, and teh environment which it functions. Chapter 3 goes into much more detail on the representation language, including the structure and function of Cyc's metalevel agenda mechanism. Chapter 4 presents heuristics for ontological engineering, the pricnples upon whcihc Cyc's ontology is based. Chapter 5 the provides a glimpse into the global ontology of knowledge. Chapter 6 explains how we "solve" (i.e., adequately handle) the various tough representation thorns (substances, time, space, structures, composite mental/physical objects, beliefs, uncertainty, etc. ). Chapter 7 surveys the mistakes that new knowledge tnereres most often commit. Chapter 8, the concluding chapter, includes a brief status report on the project, and a statement of goals and a timetable for the coming five years.
Publisher: Addison Wesley Publishing Company
ISBN:
Category : Computers
Languages : en
Pages : 408
Book Description
Chapter one presents the Cyc "philosophy" or paradigm. Chapter 2 presents a global overview of Cyc, including its representation language, the ontology f its knowledge base, and teh environment which it functions. Chapter 3 goes into much more detail on the representation language, including the structure and function of Cyc's metalevel agenda mechanism. Chapter 4 presents heuristics for ontological engineering, the pricnples upon whcihc Cyc's ontology is based. Chapter 5 the provides a glimpse into the global ontology of knowledge. Chapter 6 explains how we "solve" (i.e., adequately handle) the various tough representation thorns (substances, time, space, structures, composite mental/physical objects, beliefs, uncertainty, etc. ). Chapter 7 surveys the mistakes that new knowledge tnereres most often commit. Chapter 8, the concluding chapter, includes a brief status report on the project, and a statement of goals and a timetable for the coming five years.
Graph Representation Learning
Author: William L. William L. Hamilton
Publisher: Springer Nature
ISBN: 3031015886
Category : Computers
Languages : en
Pages : 141
Book Description
Graph-structured data is ubiquitous throughout the natural and social sciences, from telecommunication networks to quantum chemistry. Building relational inductive biases into deep learning architectures is crucial for creating systems that can learn, reason, and generalize from this kind of data. Recent years have seen a surge in research on graph representation learning, including techniques for deep graph embeddings, generalizations of convolutional neural networks to graph-structured data, and neural message-passing approaches inspired by belief propagation. These advances in graph representation learning have led to new state-of-the-art results in numerous domains, including chemical synthesis, 3D vision, recommender systems, question answering, and social network analysis. This book provides a synthesis and overview of graph representation learning. It begins with a discussion of the goals of graph representation learning as well as key methodological foundations in graph theory and network analysis. Following this, the book introduces and reviews methods for learning node embeddings, including random-walk-based methods and applications to knowledge graphs. It then provides a technical synthesis and introduction to the highly successful graph neural network (GNN) formalism, which has become a dominant and fast-growing paradigm for deep learning with graph data. The book concludes with a synthesis of recent advancements in deep generative models for graphs—a nascent but quickly growing subset of graph representation learning.
Publisher: Springer Nature
ISBN: 3031015886
Category : Computers
Languages : en
Pages : 141
Book Description
Graph-structured data is ubiquitous throughout the natural and social sciences, from telecommunication networks to quantum chemistry. Building relational inductive biases into deep learning architectures is crucial for creating systems that can learn, reason, and generalize from this kind of data. Recent years have seen a surge in research on graph representation learning, including techniques for deep graph embeddings, generalizations of convolutional neural networks to graph-structured data, and neural message-passing approaches inspired by belief propagation. These advances in graph representation learning have led to new state-of-the-art results in numerous domains, including chemical synthesis, 3D vision, recommender systems, question answering, and social network analysis. This book provides a synthesis and overview of graph representation learning. It begins with a discussion of the goals of graph representation learning as well as key methodological foundations in graph theory and network analysis. Following this, the book introduces and reviews methods for learning node embeddings, including random-walk-based methods and applications to knowledge graphs. It then provides a technical synthesis and introduction to the highly successful graph neural network (GNN) formalism, which has become a dominant and fast-growing paradigm for deep learning with graph data. The book concludes with a synthesis of recent advancements in deep generative models for graphs—a nascent but quickly growing subset of graph representation learning.
Information Theory, Inference and Learning Algorithms
Author: David J. C. MacKay
Publisher: Cambridge University Press
ISBN: 9780521642989
Category : Computers
Languages : en
Pages : 694
Book Description
Information theory and inference, taught together in this exciting textbook, lie at the heart of many important areas of modern technology - communication, signal processing, data mining, machine learning, pattern recognition, computational neuroscience, bioinformatics and cryptography. The book introduces theory in tandem with applications. Information theory is taught alongside practical communication systems such as arithmetic coding for data compression and sparse-graph codes for error-correction. Inference techniques, including message-passing algorithms, Monte Carlo methods and variational approximations, are developed alongside applications to clustering, convolutional codes, independent component analysis, and neural networks. Uniquely, the book covers state-of-the-art error-correcting codes, including low-density-parity-check codes, turbo codes, and digital fountain codes - the twenty-first-century standards for satellite communications, disk drives, and data broadcast. Richly illustrated, filled with worked examples and over 400 exercises, some with detailed solutions, the book is ideal for self-learning, and for undergraduate or graduate courses. It also provides an unparalleled entry point for professionals in areas as diverse as computational biology, financial engineering and machine learning.
Publisher: Cambridge University Press
ISBN: 9780521642989
Category : Computers
Languages : en
Pages : 694
Book Description
Information theory and inference, taught together in this exciting textbook, lie at the heart of many important areas of modern technology - communication, signal processing, data mining, machine learning, pattern recognition, computational neuroscience, bioinformatics and cryptography. The book introduces theory in tandem with applications. Information theory is taught alongside practical communication systems such as arithmetic coding for data compression and sparse-graph codes for error-correction. Inference techniques, including message-passing algorithms, Monte Carlo methods and variational approximations, are developed alongside applications to clustering, convolutional codes, independent component analysis, and neural networks. Uniquely, the book covers state-of-the-art error-correcting codes, including low-density-parity-check codes, turbo codes, and digital fountain codes - the twenty-first-century standards for satellite communications, disk drives, and data broadcast. Richly illustrated, filled with worked examples and over 400 exercises, some with detailed solutions, the book is ideal for self-learning, and for undergraduate or graduate courses. It also provides an unparalleled entry point for professionals in areas as diverse as computational biology, financial engineering and machine learning.