Chapter 5. Grounding Spoken Language
Author: Cynthia Matuszek
Abstract: In this chapter, language is considered as a mechanism of referencing concepts in the physical world, and how natural language processing dovetails with work on using speech and making sense of language in a robot’s environment is explored. Grounded language acquisition as a research area is examined, and a case study is presented of learning grounded language from speech by examining the question from three distinct-but-related angles: the need for complex perceptual data (and a resulting corpus), the need to learn to interact directly from speech without using a textual intermediary, and the problem of learning grounded language from richly multimodal data.