Prof. Dr. Kircher and Prof. Dr. Straube

Predictive perception: multisensory consequences of one`s own actions A3

Planned research

Project A3 combines psychophysics and neuroimaging to obtain a unified account of multisensory predictive mechanisms and the differential effect they have on perception of action feedback and action outcome. We will study 1) the multisensory perception of continuous audio-visual feedback of hand actions and discrete action outcomes, 2) individual differences in multisensory processing and 3) recalibration processes in context of repeated delays. Our research tries to bridge the gap between multisensory processing, action-related predictive mechanisms and cross-modal adaptation to reveal the mechanisms underlying action monitoring in natural conditions.

Current research

The goal of this project is to investigate the effects of predictive mechanisms on multisensory consequences of one`s own actions. The investigations will focus on three different aspects: 1) supramodal vs. unimodal effects of action-sensory feedback matching processing, 2) the neural correlates of supramodal predictive mechanisms and their consequences and 3) the investigation of predictive mechanisms for tool-use actions and the perception of related multisensory consequences.

new project-related publications

  • Arikan , B.E., van Kemenade , B.M., Straube, B., Harris, L.H., & Kircher , T. (2017). Voluntary and Involuntary Movements Widen the Window of Subjective Simultaneity. i-Perception, 8(4), 2041669517719297. DOI find paper
  • Backasch, B., Sommer, J., Klöhn-Saghatolislam, F., Müller, M.J., Kircher, T.T., & Leube, D.T. (2014). Dysconnectivity of the inferior frontal gyrus: Implications for an impaired self-other distinction in patients with schizophrenia. Psychiatry Research, 223:202-209. find paper
  • He, Y., Gebhardt, H., Steines, M., Sammer, G., Kircher, T., Nagels, A., & Straube, B. (2015). The EEG and fMRI signatures of neural integration: An investigation of meaningful gestures and corresponding speech. Neuropsychologia, 72, 27-42.DOI find paper
  • Nagels, A., Kircher, T., Steines, M., Grosvald, M., & Straube, B. (2015). A brief self-rating scale for the assessment of individual differences in gesture perception and production. Learning and Individual Differences, 39, 73–80. DOI find paper
  • Schmalenbach, S.B., Billino, J., Kircher, T., van Kemenade, B.M., & Straube, B. (2017). Links between gestures and multisensory processing: individual differences suggest a compensation mechanism. Frontiers in Psychology, 8:1828 find paper
  • Schuelke, R., & Straube, B. (2017). Modulating the assessment of semantic speech–gesture relatedness via transcranial direct current stimulation of the left frontal cortex. Brain Stimulation, 10(2), 223–230. DOI find paper
  • Straube, B., Green, A., Sass, K., & Kircher, T. (2014). Superior Temporal Sulcus Disconnectivity During Processing of Metaphoric Gestures in Schizophrenia. Schizophrenia Bulletin, 40(4), 936?944. DOI find paper
  • Straube, B., Schülke, R., Drewing, K., Kircher, T., & van Kemenade, B.M. (2017). Hemispheric differences in the processing of visual consequences of active vs. passive movements: A transcranial direct current stimulation study. Experimental Brain Research, in press. find paper
  • Straube, B., van Kemenade, B. M., Arikan, B. E., Fiehler, K., Harris, L. R., Leube, D., & Kircher, T. (2017). Predicting the multisensory consequences of one's own action: BOLD suppression in auditory and visual cortices. PLOS ONE, 12(1), e0169131. DOI find paper
  • Van Kemenade, B. M., Kircher, T., Arikan, B. E., & Straube, B. (2016). Predicting the sensory consequences of one’s own action: First evidence for multisensory facilitation. Attention, Perception, & Psychophysics, 78(8), 2515-2526. DOI find paper
  • Van Kemenade, B.M., Arikan, B.E., Podranski, K., Steinsträter, O., Kircher, T., & Straube, B. (2018). Distinct roles for the cerebellum, angular gyrus and middle temporal gyrus in action-feedback monitoring. Cerebral Cortex, in press.
  • Wende, K. C., Nagels, A., Stratmann, M., Chatterjee, A., Kircher, T., & Straube, B. (2015). Neural basis of altered physical and social causality judgements in schizophrenia. Schizophrenia Research, 161(2–3), 244–251. find paper
  • van Kemenade, B.M., Arikan, B.E., Kircher, T., & Straube, B. (2017). The angular gyrus is a supramodal comparator area in action-outcome monitoring. Brain Structure and Function, 1-13. DOI find paper

former project-related publications

  • Blos, J., Chatterjee, A., Kircher, T., & Straube, B. (2012). Neural correlates of causality judgment in physical and social context – the reversed effects of space and time. NeuroImage, 63(2), 882-93.
  • Green, A., Straube, B., Weis, S., Jansen, A., Willmes, K., Konrad, K., & Kircher, T. (2009). Neural integration of iconic and unrelated coverbal gestures: a functional MRI study. Human Brain Mapping, 30(10), 3309–3324.
  • Knoblich G., Stottmeister F., Kircher T. (2004). Self-monitoring in patients with schizophrenia. Psychol Med., 34, 1561-9.
  • Knoblich, G., & Kircher, T. (2004). Deceiving Oneself About Being in Control: Conscious Detection of Changes in Visuomotor Coupling. Journal of Experimental Psychology: Human Perception and Performance, 30(4), 657–666.
  • Leube D.T., Knoblich G., Erb M., Grodd W., Bartels M., Kircher T.T. (2003b). The neural correlates of perceiving one's own movements. Neuroimage, 20, 2084- 90.
  • Leube D.T., Knoblich G., Erb M., Kircher T.T. (2003a). Observing one's hand become anarchic: an fMRI study of action identification. Conscious Cogn, 12, 597-608.
  • Leube DT, Knoblich G, Erb M, Schlotterbeck P, Kircher T (2010). The neural basis of disturbed efference copy mechanism in patients with schizophrenia. Cognitive Neuroscience, 1, 111-117.
  • Lindner A., Thier P., Kircher T.T., Haarmeier T., Leube D.T. (2005). Disorders of agency in schizophrenia correlate with an inability to compensate for the sensory consequences of actions. Curr Biol., 15, 1119-24.
  • Mainieri A.G., Heim S., Straube B., Binkofski F., Kircher T. (2013). Differential Role of Mentalizing and the Mirror Neuron System in the Imitation of Communicative Gestures. NeuroImage, 81, 294–305.
  • Straube B., Wolk D., Chatterjee A. (2011). The role of the right parietal lobe in the perception of causality: a tDCS study. Experimental Brain Research, 215(3), 315–325.
  • Straube, B., Green, A., Bromberger, B. & Kircher, T. (2011). The differentiation of iconic and metaphoric gestures: Common and unique integration processes. Human Brain Mapping, 32, 520-533.
  • Straube, B., Green, A., Weis, S., & Kircher, T. (2012). A Supramodal Neural Network for Speech and Gesture Semantics: An fMRI Study. PLoS ONE, 7(11), e51207. doi:10.1371/journal.pone.0051207.
  • Straube, B., He, Y., Steines, M., Gebhardt, H., Kircher, T., Sammer, G., & Nagels, A. (2013). Supramodal neural processing of abstract information conveyed by speech and gesture. Frontiers in Behavioral Neuroscience, 7. doi:10.3389/fnbeh.2013.00120