At the Cognition Across the Senses lab we study the role of multisensory processes in perception, attention, space representation and language in typical and atypical populations. We combine methods from psychophysics, neuropsychology, social psychology and neuroimaging (EEG, fMRI) to investigate primarily two topics: (1) Cognition in profoundly deaf, hard-of-hearing and people with cochlear implant; (2) Own body perception.
Cognition in profoundly deaf, hard-of-hearing and people with cochlear implant
Auditory space processing and multisensory spatial attention in people with cochlear implant
This research line is currently supported by a grant from Agence Nationale de la Recherche (ANR, France), a grant from ITMO-Aviesan (France), a grant from the MEDISITE Foundation (France) and a grant from the Foundation Neurodis (France).
In collaboration with: Alessandro Farnè and Valerie Gaveau (ImpAct Unit, Centre de Recherche en Neurosciences de Lyon -- CRNL, Lyon, France), Eric Truy (ENT Department at the Hospices Civils de Lyon, Lyon, France), Giuseppe Nicolò Frau and Francesca Bonfioli (ENT Department at the Rovereto Hospital, Rovereto, Italy).
- Pavani, F., Venturini, M., Baruffaldi, F., Artesini, L., Bonfioli, F., Frau, G. N., & van Zoest, W. (2017). Spatial and non-spatial multisensory cueing in unilateral cochlear implant users. Hearing research, 344, 24-37.
- Nava, E., Bottari, D., Bonfioli, F., Beltrame, M.A., & Pavani, F. (2009). Spatial hearing with a single cochlear implant: a study in prelingually deafened adults. Hearing Research, 255, 91-98.
- Nava, E., Bottari, D., Portioli, G., Bonfioli, F., Beltrame, M.A., Formigoni, P., & Pavani, F. (2009). Hearing again with two ears: Recovery of spatial hearing after bilateral cochlear implantation. Neuropsychologia, 47, 928-32.
Language processing with cochlear implant
Cochlear implants (CI) are considered one of the most successful biomedical device of the last decades. Under which conditions CIs lead to typical language development is however an area of active investigation. This research line focuses on the EEG correlates of language processing, studying well established EEG/ERP components of semantic and syntactic processing, in CI users and age-matched hearing controls. The goals are to 1) establish neural markers of language processing in deaf people with CI; 2) identify under which conditions these neural correlates diverge with respect to typical development. The long-term perspective is to provide useful indications to professionals (e.g., speech therapists, audiologists) interested in promoting language in CI users.
In collaboration with Prof. Francesco Vespignani (DiPSCo, University of Trento, Italy), Dr. Debora Musola (Coperativa Logogenia®
- Rinaldi, P., Caselli, M. C., Pavani, F. (2017). Linguaggio e sordità: il contributo delle neuroscienze cognitive. In S. Vicari e M. C. Caselli (a cura di), Neuropsicologia dello sviluppo. Bologna, Il Mulino.
- Pavani, F. (2016). Lingue dei segni, sordità e plasticità cerebrale. Le lingue dei segni come strumento di cittadinanza. Maziale, B., & Volterra, V. (Eds). Carocci.
- Pavani, F. (2014). La LIS nell’era degli impianti cocleari. Contributi alla discussione. Psicologia Clinica dello Sviluppo, 18(3), 428-470.
Visual attention in early deafness
In the last decades research on the effects of early deafness in humans have documented changes in visual processing, involving the intact visual cortices as well as the deafferented auditory cortices. Behaviourally, deaf people proved particularly sensitive to transients in the visual scene, especially when they occur towards the periphery of the visual field. To what extent these neural and behavioural changes lead to visual dominance and may limit goal-oriented behaviour in deaf people remained largely unexplored. In the last years, at CAtS we have focused on the behavioural and neural changes that characterise the visual system of early deaf people. In addition, we have started to examine the ability of early deaf adults in achieving a balance between bottom-up and top-down mechanisms of selective attention. Overall, our results reveal a remarkable degree of top-down control in deaf adults, that can favour goal-oriented behaviour even within a perceptual system substantially changed by auditory-deprivation. We are now exploring how this attentional balance changes during development.
In collaboration with: Maria Cristina Caselli and Pasquale Rinaldi (ISTC-CNR, Rome, Italy), Wieske van Zoest (University of Trento, Italy)
- Heimler, B., van Zoest, W., Baruffaldi, F., Donk, M., Rinaldi, P., Caselli, M.C., & Pavani, F. (2015). Finding the balance between capture and control: oculomotor selection in early deaf adults. Brain and Cognition, 96, 12-27.
- Heimler, B., van Zoest, W., Baruffaldi, F., Rinaldi, P., Caselli, M.C., & Pavani, F. (2015). Attentional orienting to social and non-social cues in early deaf adults. Journal of Experimental Psychology: Human Perception and Psychophysics, 41(6), 1758-1771.
- Bottari, D., Heimler, B., Caclin, A., Dalmolin, A., Giard, M.-H., & Pavani, F. (2014). Visual change detection recruits auditory cortices in early deafness. Neuroimage, 94, 172-184.
- Pavani, F., & Bottari, D. (2012). Visual abilities in individuals with profound deafness: a critical review. In M. M. Murray & M. Wallace (Eds.), Frontiers in the Neural Bases of Multisensory Processes. Boca Raton, FL, USA: CRC Press.
- Bottari, D., Caclin A., Giard, M.H. & Pavani F. (2011). Changes in early cortical visual processing predict enhanced reactivity in deaf individuals. PLoS ONE, 6(9), e25607.
- Bottari, D., Nava, E., Ley, P., & Pavani, F. (2010). Enhanced reactivity of profound deaf in detection and discrimination tasks. Restorative Neurology and Neuroscience, 28, 167-79.
Own body perception
Bilateral interactions in tactile processing
According to current textbook knowledge, primary somatosensory cortex (SI) supports unilateral tactile representations, whereas structures beyond SI, in particular the secondary somatosensory cortices (SII), support bilateral tactile representations. However, dexterous and well-coordinated bimanual motor tasks require early integration of bilateral tactile information. Our work on bilateral interaction in tactile processing is contributing to show that this textbook notion need to be reconsidered. In agreement with studies in animals, our work in humans indicate that SI is more than a simple relay for unilateral sensory information and, together with SII, contributes to the integration of somatosensory inputs from both sides of the body. Interactions between tactile stimuli on the two sides of the body can occur at early stages of processing.
In collaboration with: Luigi Tamè (Birkbeck College, UK), Christoph Braun (Tubingen University, Germany), Alessandro Farné (INSERM, France), Nicholas Holmes (University of Nottingham, UK).
The perception of body size for self and others
This research program investigates body size perception for self and others, in adolescent and adults, addressing in particular the influences of social context and social comparisons in modulating this aspect of body perception. The project is led by Mara Mazzurega and Francesco Pavani. Collaborators on this project included: Chiara Valzolgher, Laura Facci, Jlenia Marisa and Silvia Scarozza.
In collaboration with: Massimiliano Zampini (CIMeC, IT)
Publications and abstracts