•During conversation, interlocutors rarely overlap or leave long gaps between turns.•We investigated how listeners use prediction to achieve such coordination.•Listeners used content predictions to ...prepare their verbal responses early.•However, they did not use these predictions to determine the speaker’s turn-end.•We suggest that content predictions aid early response preparation.
During conversation, there is often little gap between interlocutors’ utterances. In two pairs of experiments, we manipulated the content predictability of yes/no questions to investigate whether listeners achieve such coordination by (i) preparing a response as early as possible or (ii) predicting the end of the speaker’s turn. To assess these two mechanisms, we varied the participants’ task: They either pressed a button when they thought the question was about to end (Experiments 1a and 2a), or verbally answered the questions with either yes or no (Experiments 1b and 2b). Predictability effects were present when participants had to prepare a verbal response, but not when they had to predict the turn-end. These findings suggest content prediction facilitates turn-taking because it allows listeners to prepare their own response early, rather than because it helps them predict when the speaker will reach the end of their turn.
Conversation is generally characterized by smooth transitions between turns, with only very short gaps. This entails that responders often begin planning their response before the ongoing turn is ...finished. However, controversy exists about whether they start planning as early as they can, to make sure they respond on time, or as late as possible, to minimize the overlap between comprehension and production planning. Two earlier EEG studies have found neural correlates of response planning (positive ERP and alpha decrease) as soon as listeners could start planning their response, already midway through the current turn. However, in these studies, the questions asked were highly controlled with respect to the position where planning could start (e.g., very early) and required short and easy responses. The present study measured participants' EEG while an experimenter interviewed them in a spontaneous interaction. Coding the questions in the interviews showed that, under these natural circumstances, listeners can, in principle, start planning a response relatively early, on average after only about one third of the question has passed. Furthermore, ERP results showed a large positivity, interpreted before as an early neural signature of response planning, starting about half a second after the start of the word that allowed listeners to start planning a response. A second neural signature of response planning, an alpha decrease, was not replicated as reliably. In conclusion, listeners appear to start planning their response early during the ongoing turn, also under natural circumstances, presumably in order to keep the gap between turns short and respond on time. These results have several important implications for turn-taking theories, which need to explain how interlocutors deal with the overlap between comprehension and production, how they manage to come in on time, and the sources that lead to variability between conversationalists in the start of planning.
•Participants were interviewed freely while their EEG was measured.•Questions were annotated for the place where response planning could start.•Conversationalists can start planning already about one third into the question.•A large ERP positivity soon after planning could start was replicated.•Listeners start response planning as early as possible in natural turn taking.
Music has attracted longstanding debate surrounding its capacity to communicate without words, but little empirical work has addressed the topic. Here, 534 participants in the US and a remote region ...of China participated in two experiments using a novel paradigm to investigate narrative perceptions as a semantic dimension of music. Participants listened to wordless musical excerpts and determined which of two presented stories was the correct match. Correct matches were stories previously imagined by individuals from the US or China in response to each of the excerpts, while foils were correct matches to one of the other tested excerpts. Results revealed that listeners from Arkansas and Michigan had no difficulty matching the music with stories generated by Arkansas listeners. Wordless music, then, far from an abstract stimulus, seems to engender shared, concrete narrative perceptions in listeners. These perceptions are stable and robust for within-culture participants, even at geographically distinct locales (e.g. Arkansas and Michigan). This finding refutes the notion that music is an asemantic medium. In contrast, participants in both the US and China had more difficulty determining correct story-music matches for stories generated by participants from another culture, suggesting that a sufficiently shared pool of experiences must exist for strong intersubjectivity to arise.
Speech and music are highly redundant communication systems, with multiple acoustic cues signaling the existence of perceptual categories. This redundancy makes these systems robust to the influence ...of noise, but necessitates the development of perceptual strategies: listeners need to decide how much importance to place on each source of information. Prior empirical work and modeling has suggested that cue weights primarily reflect within-task statistical learning, as listeners assess the reliability with which different acoustic dimensions signal a category and modify their weights accordingly. Here we present evidence that perceptual experience can lead to changes in cue weighting that extend across tasks and across domains, suggesting that perceptual strategies reflect both global biases and local (i.e. task-specific) learning.
In two experiments, native speakers of Mandarin (N = 45)—where pitch is a crucial cue to word identity—placed more importance on pitch and less importance on other dimensions compared to native speakers of non-tonal languages English (N = 45) and Spanish (N = 27), during the perception of both English speech and musical beats. In a third experiment, we further show that Mandarin speakers are better able to attend to pitch and ignore irrelevant variation in other dimensions in speech compared to English and Spanish speakers, and even struggle to ignore pitch when asked to attend to other dimensions. Thus, an individual's idiosyncratic auditory perceptual strategy reflects a complex mixture of congenital predispositions, task-specific learning, and biases instilled by extensive experience in making use of important dimensions in their native language.
We examined how listeners characterized by empathy and a non-judgmental approach affect speakers' attitude structure. We hypothesized that high quality listening decreases speakers' social anxiety, ...which in turn reduces defensive processing. This reduction in defensive processing was hypothesized to result in an awareness of contradictions (increased objective-attitude ambivalence), and decreased attitude extremity. Moreover, we hypothesized that experiencing high quality listening would enable speakers to tolerate contradictory responses, such that listening would attenuate the association between objective- and subjective-attitude ambivalence. We obtained consistent support for our hypotheses across four laboratory experiments that manipulated listening experience in different ways on a range of attitude topics. The effects of listening on objective-attitude ambivalence were stronger for higher dispositional social anxiety and initial objective-attitude ambivalence (Study 4). Overall, the results suggest that speakers' attitude structure can be changed by a heretofore unexplored interpersonal variable: merely providing high quality listening.
Stories are known to be powerful persuasive devices. Stories can capture attention, evoke emotion, and entrance listeners in a manner that reduces resistance to a message. Given the powerful ...persuasive potential of stories, one might deduce that it is best to embed one’s facts within a story. In contrast to this perspective, the present research suggests that coupling facts with stories can either enhance or undermine persuasion. Specifically, to understand when facts benefit from the use of stories, this work provides a deeper examination of how counterargument reduction—a common explanation for the unique persuasive capabilities of stories—operates. Across three experiments, evidence is found for when it is more effective to embed facts within a story versus to use facts alone.
Bilinguals understand when the communication context calls for speaking a particular language and can switch from speaking one language to speaking the other based on such conceptual knowledge. There ...is disagreement regarding whether conceptually-based language selection is also possible in the listening modality. For example, can bilingual listeners perceptually adjust to changes in pronunciation across languages based on their conceptual understanding of which language they’re currently hearing? We asked French- and Spanish-English bilinguals to identify nonsense monosyllables as beginning with /b/ or /p/, speech categories that French and Spanish speakers pronounce differently than English speakers. We conceptually cued each bilingual group to one of their two languages or the other by explicitly instructing them that the speech items were word onsets in that language, uttered by a native speaker thereof. Both groups adjusted their /b–p/ identification boundary as a function of this conceptual cue to the language context. These results support a bilingual model permitting conceptually-based language selection on both the speaking and listening end of a communicative exchange.
Familiar and unfamiliar voice perception are often understood as being distinct from each other. For identity perception, theoretical work has proposed that listeners use acoustic information in ...different ways to perceive identity from familiar and unfamiliar voices: Unfamiliar voices are thought to be processed based on close comparisons of acoustic properties, while familiar voices are processed based on diagnostic acoustic features that activate a stored person-specific representation of that voice. To date no empirical study has directly examined whether and how familiar and unfamiliar listeners differ in their use of acoustic information for identity perception. Here, we tested this theoretical claim by linking listeners' judgements in voice identity tasks to complex acoustic representation — spectral similarity of the heard voice recordings. Participants (N = 177) who were either familiar or unfamiliar with a set of voices completed an identity discrimination task (Experiment 1) or an identity sorting task (Experiment 2). In both experiments, identity judgements for familiar and unfamiliar voices were guided by spectral similarity: Pairs of recordings with greater acoustic similarity were more likely to be perceived as belonging to the same voice identity. However, while there were no differences in how familiar and unfamiliar listeners used acoustic information for identity discrimination, differences were apparent for identity sorting. Our study therefore challenges proposals that view familiar and unfamiliar voice perception as being at all times distinct. Instead, our data suggest a critical role of the listening situation in which familiar and unfamiliar voices are evaluated, thus characterising voice identity perception as a highly dynamic process in which listeners opportunistically make use of any kind of information they can access.
Most words are ambiguous: Individual word forms (e.g., run) can map onto multiple different interpretations depending on their sentence context (e.g., the athlete/politician/river runs). Models of ...word-meaning access must therefore explain how listeners and readers can rapidly settle on a single, contextually appropriate meaning for each word that they encounter. I present a new account of word-meaning access that places semantic disambiguation at its core and integrates evidence from a wide variety of experimental approaches to explain this key aspect of language comprehension. The model has three key characteristics. (a) Lexical-semantic knowledge is viewed as a high-dimensional space; familiar word meanings correspond to stable states within this lexical-semantic space. (b) Multiple linguistic and paralinguistic cues can influence the settling process by which the system resolves on one of these familiar meanings. (c) Learning mechanisms play a vital role in facilitating rapid word-meaning access by shaping and maintaining high-quality lexical-semantic knowledge throughout the life span. In contrast to earlier models of word-meaning access, I highlight individual differences in lexical-semantic knowledge: Each person’s lexicon is uniquely structured by specific, idiosyncratic linguistic experiences.
Abstract
Word embedding representations have been shown to be effective in predicting human neural responses to lingual stimuli. While these representations are sensitive to the textual context, they ...lack the extratextual sources of context such as prior knowledge, thoughts, and beliefs, all of which constitute the listener’s perspective. In this study, we propose conceptualizing the listeners’ perspective as a source that induces changes in the embedding space. We relied on functional magnetic resonance imaging data collected by Yeshurun Y, Swanson S, Simony E, Chen J, Lazaridi C, Honey CJ, Hasson U. Same story, different story: the neural representation of interpretive frameworks. Psychol Sci. 2017:28(3):307–319, in which two groups of human listeners (n = 40) were listening to the same story but with different perspectives. Using a dedicated fine-tuning process, we created two modified versions of a word embedding space, corresponding to the two groups of listeners. We found that each transformed space was better fitted with neural responses of the corresponding group, and that the spatial distances between these spaces reflect both interpretational differences between the perspectives and the group-level neural differences. Together, our results demonstrate how aligning a continuous embedding space to a specific context can provide a novel way of modeling listeners’ intrinsic perspectives.
PDF
