Skip to main content

Ruth Campbell

University College London, Pschology, Department Member

Followers

119

Following

25

Co-authors

20

Mentions

1

Public Views

I am an experimental psychologist and neuropsychologist, with particular interests in cognitive development and its anomalies, including (but not limited to) prelingual deafness. I have a special (read 'niche' interest) in speechreading: its behavioural characteristics and neural correlates.

less

Interests

Uploads

Papers by Ruth Campbell

Cognitive and neurocognitive development in deaf children: How experience and environment affect the acquisition of cognitive skills, and how neural function reflects these life events

ABSTRACT Congenital deafness impacts on the cognitive development of the child in many and variou... more ABSTRACT Congenital deafness impacts on the cognitive development of the child in many and various ways. The aim of this chapter is to show how the life events and experiences of a deaf child launch her on a different developmental and neurocognitive trajectory than that of a typical hearing child. Congenital deafness can bring about some reconfiguration of cortical regions related to auditory processing, and also to some aspects of visual processing. However, just as important are the cortical consequences of behavioral adaptation to a world where hearing and heard language are absent or degraded. Visual attention and exposure to a SignLanguage are two factors shown to play a special role in the cognitive and neurocognitive processes of deaf people.

Viewpoint Dependent Facial Expressions Recognition Japanese Noh Masks and the Human Face

Viewpoint Dependent Facial Expression Recognition Japanese Noh Masks and the Human Face Michael J... more Viewpoint Dependent Facial Expression Recognition Japanese Noh Masks and the Human Face Michael J. Lyons , Andre Plante , Miyuki Kamachi , & Shigeru Akamatsu ([email protected]) Advanced Telecommunications Research International Media Integration & Communications Research Lab Human Information Processing Research Lab 2-2 Hikari-dai, Seika-cho, Soraku-gun, Kyoto, Japan, 619-0288 Ruth Campbell & Mike Coleman [email protected] Dept. of Human Communication Science, University College London Chandler House, 2 Wakefield St, London WC1 N 1 PG Abstract With certain masks used in Japanese Noh drama the apparent facial expression is a function of the vertical viewing angle. Rotation in depth produces changes in the retinal image of the face which viewers may confound with the distortion of fea- tures due to muscular action. In particular, as the mask is tilted forward it appears to smile, and as it is tilted backwards it ap- pears sad. We explored this effect in two experiments with a N...

Hearing Eye II, 2013

Age, gender, and puberty influence the development of facial emotion recognition

Frontiers in Psychology, 2015

Our ability to differentiate between simple facial expressions of emotion develops between infanc... more Our ability to differentiate between simple facial expressions of emotion develops between infancy and early adulthood, yet few studies have explored the developmental trajectory of emotion recognition using a single methodology across a wide age-range. We investigated the development of emotion recognition abilities through childhood and adolescence, testing the hypothesis that children's ability to recognize simple emotions is modulated by chronological age, pubertal stage and gender. In order to establish norms, we assessed 478 children aged 6-16 years, using the Ekman-Friesen Pictures of Facial Affect. We then modeled these cross-sectional data in terms of competence in accurate recognition of the six emotions studied, when the positive correlation between emotion recognition and IQ was controlled. Significant linear trends were seen in children's ability to recognize facial expressions of happiness, surprise, fear, and disgust; there was improvement with increasing age. In contrast, for sad and angry expressions there is little or no change in accuracy over the age range 6-16 years; nearadult levels of competence are established by middle-childhood. In a sampled subset, pubertal status influenced the ability to recognize facial expressions of disgust and anger; there was an increase in competence from mid to late puberty, which occurred independently of age. A small female advantage was found in the recognition of some facial expressions. The normative data provided in this study will aid clinicians and researchers in assessing the emotion recognition abilities of children and will facilitate the identification of abnormalities in a skill that is often impaired in neurodevelopmental disorders. If emotion recognition abilities are a good model with which to understand adolescent development, then these results could have implications for the education, mental health provision and legal treatment of teenagers.

Auditory-visual speech perception is abnormal in schizophrenia: An fMRI study

Aspects of hearing by eye

The development of speechreading in deaf and hearing children: introducing a new Test of Child Speechreading (ToCS)

… on Audiovisual Speech …, 2009

This paper describes the development of a new Test of Child Speechreading (ToCS) that was specifi... more

Auditory-Visual Speech Processing (AVSP) 2009

We give an overview of SynFace, a speech-driven face animation system originally developed for th... more We give an overview of SynFace, a speech-driven face animation system originally developed for the needs of hard-of-hearing users of the telephone. For the 2009 LIPS challenge, SynFace includes not only articulatory motion but also non-verbal motion of gaze, eyebrows and head, triggered by detection of acoustic correlates of prominence and cues for interaction control. In perceptual evaluations, both verbal and non-verbal movmements have been found to have positive impact on word recognition scores.

Auditory-Visual Speech Processing 2005

Development, Jul 24, 2005

It has been found that auditory-visual speech perception differs over languages, particularly bet... more It has been found that auditory-visual speech perception differs over languages, particularly between English and Japanese speakers. This difference emerges due to increased use of visual information by English speakers between 6 and 8 years [14]. This study investigates the linguistic factors that may cause changes in auditory-visual speech perception development. Children aged between 5 and 8 years were given tests of reading, articulation, language-specific speech perception and auditory-visual speech perception. The results ...

Auditory-Visual Speech Processing (AVSP'99)

Sign, language, and gesture in the brain: Some comments

Behavioral and Brain Sciences, 2017

In contrast with two widely held and contradictory views – that sign languages of deaf people are... more In contrast with two widely held and contradictory views – that sign languages of deaf people are “just gestures,” or that sign languages are “just like spoken languages” – the view from sign linguistics and developmental research in cognition presented by Goldin-Meadow & Brentari (G-M&B) indicates a more complex picture. We propose that neuroscience research suggests that a similar approach needs to be taken and offer some examples from research on the brain bases of sign language perception.

Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory–Visual Speech, edited by Ruth Campbell, Barbara Dodd, and Denis Burnham

Trends in Cognitive Sciences, 1999

Mathematical treatment of context effects in phoneme and word recognition J. Acoust.

Enclycop Ling 2006

This article was originally published in the Encyclopedia of Language & Linguistics, Second Editi... more This article was originally published in the Encyclopedia of Language & Linguistics, Second Edition, published by Elsevier, and the attached copy is provided by Elsevier for the author's benefit and for the benefit of the author's institution, for noncommercial research and educational use including without limitation use in instruction at your institution, sending it to specific colleagues who you know, and providing a copy to your institution's administrator. All other uses, reproduction and distribution, including without limitation commercial reprints, selling or licensing copies or access, or posting on open internet sites, your personal or institution's website or repository, are prohibited. For exceptions, permission may be sought for such use through Elsevier's permissions site at:

Quarterly Journal of Experimental Psychology, 1980

Recent work on integration of auditory and visual information during speech perception has indica... more Recent work on integration of auditory and visual information during speech perception has indicated that adults are surprisingly good at, and rely extensively on, lip reading. The conceptual status of lip read information is of interest: such information is at the same time both visual and phonological. Three experiments investigated the nature of short term coding of lip read information in hearing subjects. The first experiment used asynchronous visual and auditory information and showed that a subject's ability to repeat words, when heard speech lagged lip movements, was unaffected by the lag duration, both quantitatively and qualitatively. This suggests that lip read information is immediately recoded into a durable code. An experiment on serial recall of lip read items showed a serial position curve containing a recency effect (characteristic of auditory but not visual input). It was then shown that an auditory suffix diminishes the recency effect obtained with lip read st...

Cochlear implantation (CI) for prelingual deafness: the relevance of studies of brain organization and the role of first language acquisition in considering outcome success

Frontiers in human neuroscience, 2014

Cochlear implantation (CI) for profound congenital hearing impairment, while often successful in ... more Cochlear implantation (CI) for profound congenital hearing impairment, while often successful in restoring hearing to the deaf child, does not always result in effective speech processing. Exposure to non-auditory signals during the pre-implantation period is widely held to be responsible for such failures. Here, we question the inference that such exposure irreparably distorts the function of auditory cortex, negatively impacting the efficacy of CI. Animal studies suggest that in congenital early deafness there is a disconnection between (disordered) activation in primary auditory cortex (A1) and activation in secondary auditory cortex (A2). In humans, one factor contributing to this functional decoupling is assumed to be abnormal activation of A1 by visual projections-including exposure to sign language. In this paper we show that that this abnormal activation of A1 does not routinely occur, while A2 functions effectively supramodally and multimodally to deliver spoken language ir...

Interpreting gaze in Turner syndrome: impaired sensitivity to intention and emotion, but preservation of social cueing

Neuropsychologia, 2003

Women with Turner&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp... more Women with Turner&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;#39;s syndrome (TS), who lack a complete X-chromosome, show an impairment in remembering faces and in classifying &amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;quot;fear&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;quot; in face images. Could their difficulties extend to the processing of gaze? Three tasks, all of which rely on the ability to make use of the eye-region of a pictured face, are reported. Women with TS were impaired at judging mental state from images of the upper face (&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;quot;reading the mind in the eyes&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;quot;). They were also specifically impaired at interpreting &amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;quot;fear&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;quot; from displays of the eye-region of the face. However, they showed normal susceptibility to direction of gaze as an attentional cue (social cueing), since they were as sensitive as controls to the validity of the cue, under conditions where it should be ignored. In this task, unlike those of reading the upper face for intention or expression, PIQ accounted for a significant amount of individual variance in task performance. The processing of displays of the eye region affording social and affective information is specifically affected in TS. We speculate that amygdala dysfunction is likely to be implicated in this anomalous behaviour. The presence in the female karyotype of two complete X-chromosomes is protective for some socio-cognitive abilities related to the modulation of behaviour by the interpretation of gaze.

Cortical substrates for the perception of face actions: an fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning)

Cognitive Brain Research, 2001

Can the cortical substrates for the perception of face actions be distinguished when the superfic... more Can the cortical substrates for the perception of face actions be distinguished when the superficial visual qualities of these actions are very similar? Two fMRI experiments are reported. Compared with watching the face at rest, observing silent speech was associated with bilateral activation in a number of temporal cortical regions, including the superior temporal sulcus (STS). Watching face movements of similar extent and duration, but which could not be construed as speech (gurning; Experiment 1b) was not associated with activation of superior temporal cortex to the same extent, especially in the left hemisphere. Instead, the peak focus of the largest cluster of activation was in the posterior part of the inferior temporal gyrus (right, BA 37). Observing silent speech, but not gurning faces, was also associated with bilateral activation of inferior frontal cortex (BA 44 and 45). In a second study, speechreading and observing gurning faces were compared within a single experiment, using stimuli which comprised the speaker's face and torso (and hence a much smaller image of the speaker's face and facial actions). There was again differential engagement of superior temporal cortex which followed the pattern of Experiment 1. These findings suggest that superior temporal gyrus and neighbouring regions are activated bilaterally when subjects view face actions-at different scales-that can be interpreted as speech. This circuitry is not accessed to the same extent by visually similar, but linguistically meaningless actions. However, some temporal regions, such as the posterior part of the right superior temporal sulcus, appear to be common processing sites for processing both seen speech and gurns.

Deaf children's spelling: does it show sensitivity to phonology?

Journal of Deaf Studies and Deaf Education, 1999

A written pictures to spelling task was given to two groups of children, 17 deaf children from si... more A written pictures to spelling task was given to two groups of children, 17 deaf children from signing schools (average age = 10.7) and 20 hearing children learning English as a second language (ESL, average age = 10.4). The stimuli were equally divided according to frequency, phonological regularity, and orthographic regularity. We predicted that the deaf group would not differ from the ESL group in the pattern of their responses across word classes, categorized in terms of the effect of frequency and phonological and orthographic regularity. Results showed that broadly this was the case, but more detailed analysis showed that the approach of the two groups was different. More specifically, the deaf children appeared to be sensitive to, but not aware of, phonology in their spelling, whereas the ESL group showed awareness of, as well as sensitivity to, phonology in their spelling.

This and THAP –- constraints on the pronunciation of new, written words

The Quarterly Journal of Experimental Psychology Section A, 1981

The pronunciation of nonwords that start with TH is investigated in lists and sentences. The init... more The pronunciation of nonwords that start with TH is investigated in lists and sentences. The initial phoneme is usually unvoiced (as in THOUGHT) when the nonword is embedded in lists of words and nonwords. In contrast, the initial phoneme is usually voiced (as in THIS) when such nonwords are read aloud in a function word position in a sentence. These findings are inconsistent with the current dual process theory of the routes from print to sound which implies that the phonology of a new word or nonword can be derived only from a form of letter-sound correspondence which is independent of lexical/syntactic pressures.

Are you looking at me? Accuracy in processing line-of-sight in Turner syndrome

Proceedings of the Royal Society B: Biological Sciences, 2002

The behavioural phenotype of women with Turner syndrome (X-monosomy, 45,X) is poorly understood, ... more The behavioural phenotype of women with Turner syndrome (X-monosomy, 45,X) is poorly understood, but includes reports of some social development anomalies. With this in mind, accuracy of direction of gaze detection was investigated in women with Turner syndrome. Two simple experimental tasks were used to test the prediction that the ability to ascertain gaze direction from face photographs showing small lateral angular gaze deviations would be impaired in this syndrome, compared with a control population of men and women. The prediction was confirmed and was found to affect both the detection of egocentric gaze from the eyes ('is the face looking at me?') and the detection of allocentric gaze, where the eyes in a photographed face inspected one of a number of locations of attention ('where is she looking?'). We suggest that dosage-sensitive X-linked genes contribute to the development of gaze-monitoring abilities.

Cognitive and neurocognitive development in deaf children: How experience and environment affect the acquisition of cognitive skills, and how neural function reflects these life events

ABSTRACT Congenital deafness impacts on the cognitive development of the child in many and variou... more ABSTRACT Congenital deafness impacts on the cognitive development of the child in many and various ways. The aim of this chapter is to show how the life events and experiences of a deaf child launch her on a different developmental and neurocognitive trajectory than that of a typical hearing child. Congenital deafness can bring about some reconfiguration of cortical regions related to auditory processing, and also to some aspects of visual processing. However, just as important are the cortical consequences of behavioral adaptation to a world where hearing and heard language are absent or degraded. Visual attention and exposure to a SignLanguage are two factors shown to play a special role in the cognitive and neurocognitive processes of deaf people.

Viewpoint Dependent Facial Expressions Recognition Japanese Noh Masks and the Human Face

Viewpoint Dependent Facial Expression Recognition Japanese Noh Masks and the Human Face Michael J... more Viewpoint Dependent Facial Expression Recognition Japanese Noh Masks and the Human Face Michael J. Lyons , Andre Plante , Miyuki Kamachi , & Shigeru Akamatsu ([email protected]) Advanced Telecommunications Research International Media Integration & Communications Research Lab Human Information Processing Research Lab 2-2 Hikari-dai, Seika-cho, Soraku-gun, Kyoto, Japan, 619-0288 Ruth Campbell & Mike Coleman [email protected] Dept. of Human Communication Science, University College London Chandler House, 2 Wakefield St, London WC1 N 1 PG Abstract With certain masks used in Japanese Noh drama the apparent facial expression is a function of the vertical viewing angle. Rotation in depth produces changes in the retinal image of the face which viewers may confound with the distortion of fea- tures due to muscular action. In particular, as the mask is tilted forward it appears to smile, and as it is tilted backwards it ap- pears sad. We explored this effect in two experiments with a N...

Hearing Eye II, 2013

Age, gender, and puberty influence the development of facial emotion recognition

Frontiers in Psychology, 2015

Our ability to differentiate between simple facial expressions of emotion develops between infanc... more Our ability to differentiate between simple facial expressions of emotion develops between infancy and early adulthood, yet few studies have explored the developmental trajectory of emotion recognition using a single methodology across a wide age-range. We investigated the development of emotion recognition abilities through childhood and adolescence, testing the hypothesis that children's ability to recognize simple emotions is modulated by chronological age, pubertal stage and gender. In order to establish norms, we assessed 478 children aged 6-16 years, using the Ekman-Friesen Pictures of Facial Affect. We then modeled these cross-sectional data in terms of competence in accurate recognition of the six emotions studied, when the positive correlation between emotion recognition and IQ was controlled. Significant linear trends were seen in children's ability to recognize facial expressions of happiness, surprise, fear, and disgust; there was improvement with increasing age. In contrast, for sad and angry expressions there is little or no change in accuracy over the age range 6-16 years; nearadult levels of competence are established by middle-childhood. In a sampled subset, pubertal status influenced the ability to recognize facial expressions of disgust and anger; there was an increase in competence from mid to late puberty, which occurred independently of age. A small female advantage was found in the recognition of some facial expressions. The normative data provided in this study will aid clinicians and researchers in assessing the emotion recognition abilities of children and will facilitate the identification of abnormalities in a skill that is often impaired in neurodevelopmental disorders. If emotion recognition abilities are a good model with which to understand adolescent development, then these results could have implications for the education, mental health provision and legal treatment of teenagers.

Auditory-visual speech perception is abnormal in schizophrenia: An fMRI study

Aspects of hearing by eye

The development of speechreading in deaf and hearing children: introducing a new Test of Child Speechreading (ToCS)

… on Audiovisual Speech …, 2009

This paper describes the development of a new Test of Child Speechreading (ToCS) that was specifi... more

Auditory-Visual Speech Processing (AVSP) 2009

We give an overview of SynFace, a speech-driven face animation system originally developed for th... more We give an overview of SynFace, a speech-driven face animation system originally developed for the needs of hard-of-hearing users of the telephone. For the 2009 LIPS challenge, SynFace includes not only articulatory motion but also non-verbal motion of gaze, eyebrows and head, triggered by detection of acoustic correlates of prominence and cues for interaction control. In perceptual evaluations, both verbal and non-verbal movmements have been found to have positive impact on word recognition scores.

Auditory-Visual Speech Processing 2005

Development, Jul 24, 2005

It has been found that auditory-visual speech perception differs over languages, particularly bet... more It has been found that auditory-visual speech perception differs over languages, particularly between English and Japanese speakers. This difference emerges due to increased use of visual information by English speakers between 6 and 8 years [14]. This study investigates the linguistic factors that may cause changes in auditory-visual speech perception development. Children aged between 5 and 8 years were given tests of reading, articulation, language-specific speech perception and auditory-visual speech perception. The results ...

Auditory-Visual Speech Processing (AVSP'99)

Sign, language, and gesture in the brain: Some comments

Behavioral and Brain Sciences, 2017

In contrast with two widely held and contradictory views – that sign languages of deaf people are... more In contrast with two widely held and contradictory views – that sign languages of deaf people are “just gestures,” or that sign languages are “just like spoken languages” – the view from sign linguistics and developmental research in cognition presented by Goldin-Meadow & Brentari (G-M&B) indicates a more complex picture. We propose that neuroscience research suggests that a similar approach needs to be taken and offer some examples from research on the brain bases of sign language perception.

Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory–Visual Speech, edited by Ruth Campbell, Barbara Dodd, and Denis Burnham

Trends in Cognitive Sciences, 1999

Mathematical treatment of context effects in phoneme and word recognition J. Acoust.

Enclycop Ling 2006

This article was originally published in the Encyclopedia of Language & Linguistics, Second Editi... more This article was originally published in the Encyclopedia of Language & Linguistics, Second Edition, published by Elsevier, and the attached copy is provided by Elsevier for the author's benefit and for the benefit of the author's institution, for noncommercial research and educational use including without limitation use in instruction at your institution, sending it to specific colleagues who you know, and providing a copy to your institution's administrator. All other uses, reproduction and distribution, including without limitation commercial reprints, selling or licensing copies or access, or posting on open internet sites, your personal or institution's website or repository, are prohibited. For exceptions, permission may be sought for such use through Elsevier's permissions site at:

Quarterly Journal of Experimental Psychology, 1980

Recent work on integration of auditory and visual information during speech perception has indica... more Recent work on integration of auditory and visual information during speech perception has indicated that adults are surprisingly good at, and rely extensively on, lip reading. The conceptual status of lip read information is of interest: such information is at the same time both visual and phonological. Three experiments investigated the nature of short term coding of lip read information in hearing subjects. The first experiment used asynchronous visual and auditory information and showed that a subject's ability to repeat words, when heard speech lagged lip movements, was unaffected by the lag duration, both quantitatively and qualitatively. This suggests that lip read information is immediately recoded into a durable code. An experiment on serial recall of lip read items showed a serial position curve containing a recency effect (characteristic of auditory but not visual input). It was then shown that an auditory suffix diminishes the recency effect obtained with lip read st...

Cochlear implantation (CI) for prelingual deafness: the relevance of studies of brain organization and the role of first language acquisition in considering outcome success

Frontiers in human neuroscience, 2014

Cochlear implantation (CI) for profound congenital hearing impairment, while often successful in ... more Cochlear implantation (CI) for profound congenital hearing impairment, while often successful in restoring hearing to the deaf child, does not always result in effective speech processing. Exposure to non-auditory signals during the pre-implantation period is widely held to be responsible for such failures. Here, we question the inference that such exposure irreparably distorts the function of auditory cortex, negatively impacting the efficacy of CI. Animal studies suggest that in congenital early deafness there is a disconnection between (disordered) activation in primary auditory cortex (A1) and activation in secondary auditory cortex (A2). In humans, one factor contributing to this functional decoupling is assumed to be abnormal activation of A1 by visual projections-including exposure to sign language. In this paper we show that that this abnormal activation of A1 does not routinely occur, while A2 functions effectively supramodally and multimodally to deliver spoken language ir...

Interpreting gaze in Turner syndrome: impaired sensitivity to intention and emotion, but preservation of social cueing

Neuropsychologia, 2003

Women with Turner&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp... more Women with Turner&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;#39;s syndrome (TS), who lack a complete X-chromosome, show an impairment in remembering faces and in classifying &amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;quot;fear&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;quot; in face images. Could their difficulties extend to the processing of gaze? Three tasks, all of which rely on the ability to make use of the eye-region of a pictured face, are reported. Women with TS were impaired at judging mental state from images of the upper face (&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;quot;reading the mind in the eyes&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;quot;). They were also specifically impaired at interpreting &amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;quot;fear&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;quot; from displays of the eye-region of the face. However, they showed normal susceptibility to direction of gaze as an attentional cue (social cueing), since they were as sensitive as controls to the validity of the cue, under conditions where it should be ignored. In this task, unlike those of reading the upper face for intention or expression, PIQ accounted for a significant amount of individual variance in task performance. The processing of displays of the eye region affording social and affective information is specifically affected in TS. We speculate that amygdala dysfunction is likely to be implicated in this anomalous behaviour. The presence in the female karyotype of two complete X-chromosomes is protective for some socio-cognitive abilities related to the modulation of behaviour by the interpretation of gaze.

Cortical substrates for the perception of face actions: an fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning)

Cognitive Brain Research, 2001

Can the cortical substrates for the perception of face actions be distinguished when the superfic... more Can the cortical substrates for the perception of face actions be distinguished when the superficial visual qualities of these actions are very similar? Two fMRI experiments are reported. Compared with watching the face at rest, observing silent speech was associated with bilateral activation in a number of temporal cortical regions, including the superior temporal sulcus (STS). Watching face movements of similar extent and duration, but which could not be construed as speech (gurning; Experiment 1b) was not associated with activation of superior temporal cortex to the same extent, especially in the left hemisphere. Instead, the peak focus of the largest cluster of activation was in the posterior part of the inferior temporal gyrus (right, BA 37). Observing silent speech, but not gurning faces, was also associated with bilateral activation of inferior frontal cortex (BA 44 and 45). In a second study, speechreading and observing gurning faces were compared within a single experiment, using stimuli which comprised the speaker's face and torso (and hence a much smaller image of the speaker's face and facial actions). There was again differential engagement of superior temporal cortex which followed the pattern of Experiment 1. These findings suggest that superior temporal gyrus and neighbouring regions are activated bilaterally when subjects view face actions-at different scales-that can be interpreted as speech. This circuitry is not accessed to the same extent by visually similar, but linguistically meaningless actions. However, some temporal regions, such as the posterior part of the right superior temporal sulcus, appear to be common processing sites for processing both seen speech and gurns.

Deaf children's spelling: does it show sensitivity to phonology?

Journal of Deaf Studies and Deaf Education, 1999

A written pictures to spelling task was given to two groups of children, 17 deaf children from si... more A written pictures to spelling task was given to two groups of children, 17 deaf children from signing schools (average age = 10.7) and 20 hearing children learning English as a second language (ESL, average age = 10.4). The stimuli were equally divided according to frequency, phonological regularity, and orthographic regularity. We predicted that the deaf group would not differ from the ESL group in the pattern of their responses across word classes, categorized in terms of the effect of frequency and phonological and orthographic regularity. Results showed that broadly this was the case, but more detailed analysis showed that the approach of the two groups was different. More specifically, the deaf children appeared to be sensitive to, but not aware of, phonology in their spelling, whereas the ESL group showed awareness of, as well as sensitivity to, phonology in their spelling.

This and THAP –- constraints on the pronunciation of new, written words

The Quarterly Journal of Experimental Psychology Section A, 1981

The pronunciation of nonwords that start with TH is investigated in lists and sentences. The init... more The pronunciation of nonwords that start with TH is investigated in lists and sentences. The initial phoneme is usually unvoiced (as in THOUGHT) when the nonword is embedded in lists of words and nonwords. In contrast, the initial phoneme is usually voiced (as in THIS) when such nonwords are read aloud in a function word position in a sentence. These findings are inconsistent with the current dual process theory of the routes from print to sound which implies that the phonology of a new word or nonword can be derived only from a form of letter-sound correspondence which is independent of lexical/syntactic pressures.

Are you looking at me? Accuracy in processing line-of-sight in Turner syndrome

Proceedings of the Royal Society B: Biological Sciences, 2002

The behavioural phenotype of women with Turner syndrome (X-monosomy, 45,X) is poorly understood, ... more The behavioural phenotype of women with Turner syndrome (X-monosomy, 45,X) is poorly understood, but includes reports of some social development anomalies. With this in mind, accuracy of direction of gaze detection was investigated in women with Turner syndrome. Two simple experimental tasks were used to test the prediction that the ability to ascertain gaze direction from face photographs showing small lateral angular gaze deviations would be impaired in this syndrome, compared with a control population of men and women. The prediction was confirmed and was found to affect both the detection of egocentric gaze from the eyes ('is the face looking at me?') and the detection of allocentric gaze, where the eyes in a photographed face inspected one of a number of locations of attention ('where is she looking?'). We suggest that dosage-sensitive X-linked genes contribute to the development of gaze-monitoring abilities.