You are here

Joseph Giorgio

Early Stage Researcher
United Kingdom
Modelling multisensory perception using deep neural networks.

The proposed study will look at investigating the mechanisms of multisensory perception and how these may be affected in cases of sensory deprivation and cognitive decline.The proposed study will aim to link the hierarchical units in multisensory perception through the use of deep neural networks.To infer how sensory organs capture the external environment convergent sensory streams of information will be modelled, with representational layers ranging from a neural firing level to a unified multi-sensory signal. Work using single nerve cell recordings and EEG will be utilised to represent the hierarchical processing of these signals. Extending from the lower level perceptual mechanisms a second tier of neural processing will be modelled to incorporate higher cognitive function and aim to complete the model of perception. To achieve this layers will be modelled accounting for lower order spectral and temporal perception to higher order categorical representations.  Using functional Magnetic Resonance Imaging (fMRI) brain activity measures will be used to infer these different levels of cognitive perception.

Institution
Location