Perceptual optimization of language: Evidence from American Sign Language

Naomi Caselli, Corrine Occhino, Bruno Artacho, Andreas Savakis, Matthew Dye

Research output: Contribution to journalArticlepeer-review

Abstract

If language has evolved for communication, languages should be structured such that they maximize the efficiency of processing. What is efficient for communication in the visual-gestural modality is different from the auditory-oral modality, and we ask here whether sign languages have adapted to the affordances and constraints of the signed modality. During sign perception, perceivers look almost exclusively at the lower face, rarely looking down at the hands. This means that signs articulated far from the lower face must be perceived through peripheral vision, which has less acuity than central vision. We tested the hypothesis that signs that are more predictable (high frequency signs, signs with common handshapes) can be produced further from the face because precise visual resolution is not necessary for recognition. Using pose estimation algorithms, we examined the structure of over 2000 American Sign Language lexical signs to identify whether lexical frequency and handshape probability affect the position of the wrist in 2D space. We found that frequent signs with rare handshapes tended to occur closer to the signer's face than frequent signs with common handshapes, and that frequent signs are generally more likely to be articulated further from the face than infrequent signs. Together these results provide empirical support for anecdotal assertions that the phonological structure of sign language is shaped by the properties of the human visual and motor systems.

Original languageEnglish (US)
Article number105040
JournalCognition
Volume224
DOIs
StatePublished - Jul 2022

Keywords

  • American Sign Language
  • Language optimization
  • Language perception
  • Language production
  • Pose estimation

ASJC Scopus subject areas

  • Language and Linguistics
  • Experimental and Cognitive Psychology
  • Developmental and Educational Psychology
  • Linguistics and Language
  • Cognitive Neuroscience

Fingerprint

Dive into the research topics of 'Perceptual optimization of language: Evidence from American Sign Language'. Together they form a unique fingerprint.

Cite this