Processing of Visual and Auditory Information in Speech Perception PDF Download

Author: Michael Martin Cohen
Publisher:
ISBN:
Category : Auditory perception
Languages : en
Pages : 292

View

Book Description

Author: David G. Stork
Publisher: Springer Science & Business Media
ISBN: 9783540612643
Category : Technology & Engineering
Languages : en
Pages : 720

View

Book Description
This book is one outcome of the NATO Advanced Studies Institute (ASI) Workshop, "Speechreading by Man and Machine," held at the Chateau de Bonas, Castera-Verduzan (near Auch, France) from August 28 to Septem ber 8, 1995 - the first interdisciplinary meeting devoted the subject of speechreading ("lipreading"). The forty-five attendees from twelve countries covered the gamut of speechreading research, from brain scans of humans processing bi-modal stimuli, to psychophysical experiments and illusions, to statistics of comprehension by the normal and deaf communities, to models of human perception, to computer vision and learning algorithms and hardware for automated speechreading machines. The first week focussed on speechreading by humans, the second week by machines, a general organization that is preserved in this volume. After the in evitable difficulties in clarifying language and terminology across disciplines as diverse as human neurophysiology, audiology, psychology, electrical en gineering, mathematics, and computer science, the participants engaged in lively discussion and debate. We think it is fair to say that there was an atmosphere of excitement and optimism for a field that is both fascinating and potentially lucrative. Of the many general results that can be taken from the workshop, two of the key ones are these: • The ways in which humans employ visual image for speech recogni tion are manifold and complex, and depend upon the talker-perceiver pair, severity and age of onset of any hearing loss, whether the topic of conversation is known or unknown, the level of noise, and so forth.

Author: Dominic W. Massaro
Publisher: Psychology Press
ISBN: 131776045X
Category : Language Arts & Disciplines
Languages : en
Pages : 356

View

Book Description
First published in 1987. This book is about the processing of information. The central domain of interest is face-to-face communication in which the speaker makes available both audible and visible characteristics to the perceiver. Articulation by the speaker creates changes in atmospheric pressure for hearing and provides tongue, lip, jaw, and facial movements for seeing. These characteristics must be processed by the perceiver to recover the message conveyed by the speaker. The speaker and perceiver must share a language to make communication possible; some internal representation is necessarily functional for the perceiver to recover the message of the speak.

Author: Nicholas Altieri
Publisher: Frontiers E-books
ISBN: 2889192512
Category : Brain
Languages : en
Pages : 102

View

Book Description
Perceptual processes mediating recognition, including the recognition of objects and spoken words, is inherently multisensory. This is true in spite of the fact that sensory inputs are segregated in early stages of neuro-sensory encoding. In face-to-face communication, for example, auditory information is processed in the cochlea, encoded in auditory sensory nerve, and processed in lower cortical areas. Eventually, these “sounds” are processed in higher cortical pathways such as the auditory cortex where it is perceived as speech. Likewise, visual information obtained from observing a talker’s articulators is encoded in lower visual pathways. Subsequently, this information undergoes processing in the visual cortex prior to the extraction of articulatory gestures in higher cortical areas associated with speech and language. As language perception unfolds, information garnered from visual articulators interacts with language processing in multiple brain regions. This occurs via visual projections to auditory, language, and multisensory brain regions. The association of auditory and visual speech signals makes the speech signal a highly “configural” percept. An important direction for the field is thus to provide ways to measure the extent to which visual speech information influences auditory processing, and likewise, assess how the unisensory components of the signal combine to form a configural/integrated percept. Numerous behavioral measures such as accuracy (e.g., percent correct, susceptibility to the “McGurk Effect”) and reaction time (RT) have been employed to assess multisensory integration ability in speech perception. On the other hand, neural based measures such as fMRI, EEG and MEG have been employed to examine the locus and or time-course of integration. The purpose of this Research Topic is to find converging behavioral and neural based assessments of audiovisual integration in speech perception. A further aim is to investigate speech recognition ability in normal hearing, hearing-impaired, and aging populations. As such, the purpose is to obtain neural measures from EEG as well as fMRI that shed light on the neural bases of multisensory processes, while connecting them to model based measures of reaction time and accuracy in the behavioral domain. In doing so, we endeavor to gain a more thorough description of the neural bases and mechanisms underlying integration in higher order processes such as speech and language recognition.

Author: Alan Slater
Publisher: Psychology Press
ISBN: 9780863778513
Category : Psychology
Languages : en
Pages : 452

View

Book Description
The aim of this book is both to reflect current knowledge of perceptual development and to point to some of the many questions that remain unanswered. The study of perceptual development is now a sophisticated science. The majority of the chapters tell a fascinating detective story: the way in which infants perceive and understand the world as they develop. Each of the major sections is prefaced by introductory comments, and the book will be useful for advanced undergraduates, postgraduates, researchers, and other professionals who have an interest in early perceptual development and in infancy in general.

Author: Ruth Campbell
Publisher: Psychology Press
ISBN: 9780863775024
Category : Computers
Languages : en
Pages : 338

View

Book Description
This volume outlines developments in practical and theoretical research into speechreading lipreading.

Author: Douglas Burnham
Publisher: Psychology Press
ISBN: 1135471967
Category : Psychology
Languages : en
Pages : 318

View

Book Description
This volume outlines some of the developments in practical and theoretical research into speechreading lipreading that have taken place since the publication of the original "Hearing by Eye". It comprises 15 chapters by international researchers in psychology, psycholinguistics, experimental and clinical speech science, and computer engineering. It answers theoretical questions what are the mechanisms by which heard and seen speech combine? and practical ones what makes a good speechreader? Can machines be programmed to recognize seen and seen-and-heard speech?. The book is written in a non-technical way and starts to articulate a behaviourally-based but cross-disciplinary programme of research in understanding how natural language can be delivered by different modalities.

Author: Dominic W. Massaro
Publisher: Academic Press
ISBN: 1483258289
Category : Language Arts & Disciplines
Languages : en
Pages : 452

View

Book Description
Understanding Language: An Information-Processing Analysis of Speech Perception, Reading, and Psycholinguistics focuses on the progress of approaches, principles, and practices involved in speech perception, reading, and psycholinguistics. The selection first offers information on language and information processing, articulatory and acoustic characteristics of speech sounds, and acoustic features in speech perception. Discussions focus on vowel and consonant recognition, production of speech sounds, general acoustic properties and occurrence of speech sounds, vowel phonemes of English, and information, auditory, and visual information processing. The text then examines preperceptual images, processing time, and perceptual units in speech perception, theories of perception, and visual features, preperceptual storage, and processing time in reading. Topics include processing time, visual features, summary of information-processing analysis of speech perception, role of linguistic structure in model building, and preperceptual images and processing time. The manuscript takes a look at an analysis of psychological studies of grammar, word and phrase recognition in speech processing, and linguistic theory and information processing, including psychological function of certain transformation rules, psychological reality of constituent structure, and linguistics and psychology. The selection is a vital source of data for researchers interested in speech perception, reading, and psycholinguistics.

Author: Brian Moore
Publisher: Oxford University Press, USA
ISBN: 0199561311
Category : Language Arts & Disciplines
Languages : en
Pages : 356

View

Book Description
Spoken language communication is arguably the most important activity that distinguishes humans from nonhuman species. While many animal species communicate and exchange information using sound, humans are unique in the complexity of the information that can be conveyed using speech, and in the range of ideas, thoughts and emotions that can be expressed. Despite the importance of speech communication for the entire structure of human society, there are many aspects of this process that are not fully understood. One problem is that research on speech and language is typically carried out by different groups of scientists working on separate aspects of the underlying functional and neural systems. On the one hand, research from an auditory perspective focuses on the acoustical properties of speech sounds, their representation in the auditory system, and how that representation is used to extract phonetic information. On the other hand, research from psycholinguistic perspectives examines the processes by which representations of meaning are extracted from the acoustic-phonetic sequence, and how these are linked to the construction of higher-level linguistic interpretation in terms of sentences and discourse. Till now, there has been relatively little interaction between speech researchers from these two groups, in spite of a dramatic expansion in recent years of research into the neural bases of auditory and linguistic functions. This book bridges the gap between these two lines of research, recognising that both have the same aims in understanding how the motor gestures of a speaker are transformed to sounds and how those are mapped onto meaning in the comprehension of spoken language. It presents the work of leading researchers specializing in a wide range of topics within speech perception and language processing - along with contributions from key researchers in neuroanatomy and neuro-imaging. This important new work cuts through the traditional boundaries and fosters crossdisciplinary interactions in this important and rapidly developing area of the biological and cognitive sciences.

Author: Derek A. Sanders
Publisher: Prentice Hall
ISBN:
Category : Language Arts & Disciplines
Languages : en
Pages : 264

View

Book Description