Comprehending spoken language requires extracting syntactic structure and meaning from a continuous acoustic signal. Psycholinguistic evidence points to a key role for prosody in this process. However, because interactions between prosody and syntax are typically demonstrated using carefully controlled sentence constructions, it remains unclear whether such interactions constitute a general, default property of spoken language processing. Addressing this question requires naturalistic, broad-coverage data. Here, we combined experimental psycholinguistics with naturalistic neuroscience to investigate the joint neural encoding of syntax and prosody in MEG recordings of 26 participants (19 female) listening to narrative speech. Linguistic annotations revealed that strong prosodic boundaries tend to coincide with syntactic phrase closures, and that the strength of prosodic boundaries scales with the number of phrases closed. Using time-resolved regression with temporal response functions, we modeled how these features relate to delta-band neural activity during continuous speech processing. Our results reveal a bidirectional interaction between syntax and prosody. Prosodic marking modulates the neural processing of syntax, with phrase closures being encoded more strongly when accompanied by strong prosodic boundaries. Conversely, syntactic structure shapes prosodic encoding, such that boundary strength is neurally encoded primarily at points of syntactic phrase closure. These findings demonstrate that syntax and prosody are encoded not independently, but in a context-dependent and mutually constraining manner, highlighting their joint role in guiding structure building during naturalistic spoken language comprehension. Significance statement How the brain transforms continuous sensory stimulation into structured representations is a central question in cognitive neuroscience. Spoken language comprehension provides a particularly compelling case: as the acoustic signal alone underdetermines linguistic meaning, the brain must integrate bottom-up sensory information with top-down linguistic knowledge, such as syntax. Here, we recorded brain activity during audiobook listening to examine how syntax and prosody jointly shape neural responses to narrative speech. We find evidence for a bidirectional neural interaction: prosody modulates the neural encoding of syntax, and syntactic context shapes the neural encoding of prosody. These findings suggest that the brain flexibly integrates bottom-up and top-down information depending on how informative each cue is for extracting structured meaning from naturalistic speech.
Psycholinguistic research and linguistic theory suggest that comprehending continuous speech involves segmenting it into sentences. Yet, direct neuroimaging evidence for this process remains scarce, partly because sentence boundaries coincide with acoustic, prosodic, lexical, and syntactic changes. Here, we used whole-...
Orel Levy-David, Refael Tikoschinski, R. Reichart et al.· bioRxiv· 0 citations
Linguistic environments play an important role in shaping the mechanisms of language processing. The current study examined how neural responses to bilingual code-switching vary as a function of ongoing language usage, and which control processes may underlie these differences. Forty highly proficient English-French bi...
Stephen Theron-Grimaldi, Mirjana Bozic· Frontiers in Psychology· 0 citations
Conventional part-of-speech (PoS) labels such as nouns, verbs and adjectives conflate lexical-semantic roots, grammatical functions, and their combinations, making it unclear whether neural sensitivity to PoS reflects either dimension or the way they are combined. We adopted Croft’s typological framework to decompose m...
Z. Huang, Natalia Bekemeier, A. Hervais-Adelman· bioRxiv· 0 citations
PURPOSE
Second-language (L2) speech perception is strongly influenced by prior language experience, but the neural mechanisms supporting this process remain incompletely understood. This study examined how language experience modulates the pre-attentive encoding of acoustic and phonological information in Mandarin tone...
Yu Zou, Bing Cheng, Xiao-Juan Zhang et al.· Journal of Speech, Language...· 0 citations
One-word utterances are a common feature of spontaneous conversation, yet they remain relatively underexplored in studies of spoken Telugu. Although such responses frequently consist of a single lexical item, they often convey meanings equivalent to complete clauses through the interaction of grammatical structure and...