Prof. Dr. Fleming

Visual Categorization and Prediction of Deformable MaterialsC1

Planned research

We seek to understand the categorization of deformable materials, like liquid or cloth. Using simulated materials, we will measure how category learning generalizes to novel samples, and test whether subjects can predict the future movements of deformable materials as they interact with other objects. Finally we will model human categorization using machine learning techniques, based on analysis of the 3D shapes of the simulated materials.  We hypothesize that observers learn generative models of the ‘typical appearance’ of materials, enabling categorization and prediction.

Current research

Using simulated materials, we will measure how category learning generalizes to novel samples, and test whether subjects can predict the future movements of deformable materials as they interact with other objects. Finally we will model human categorization using machine learning techniques, based on analysis of the 3D shapes of the simulated materials.  We hypothesize that observers learn generative models of the ‘typical appearance’ of materials, enabling categorization and prediction.

new project-related publications

  • Fleming RW & Schmidt F (2019). Getting ‘‘fumpered’’: Classifying objects by what has been done to them. Journal of Vision, 19(4):15, 1–12, https://doi.org/10.1167/19.4.15 find paper
  • Kunsberg B, Holtmann-Rice D, Alexander E, Cholewiak S, Fleming RW, Zucker SW. (2018). Colour, contours, shading and shape: flow interactions reveal anchor neighbourhoods. Interface Focus 8: 20180019. http://dx.doi.org/10.1098/rsfs.2018.001945. find paper
  • Maiello G, Paulun VC, Klein LK, & Fleming RW. (2018). The Sequential-Weight Illusion. i-Perception, 9(4), 1–6. doi:10.1177/2041669518790275. find paper
  • Maiello, G., Paulun, V. C., Klein, L. K., & Fleming, R. W. (2019). Object visibility, not energy expenditure, accounts for spatial biases in human grasp selection. i-Perception, 10(1), doi: 10.1177/2041669519827608 find paper
  • Paulun VC, Buckingham G, Goodale MA & Fleming RW (2019). The Material-Weight Illusion disappears or inverts in objects made of two materials. Journal of Neurophysiology. 121: 996–1010. https://doi.org/10.1152/jn.00199.2018 find paper
  • Schmidt F & Fleming RW (2018). Identifying shape transformations from photographs of real objects. PLoS ONE 13(8): e0202115. https://doi.org/10.1371/journal.pone.0202115 find paper
  • Schmidt F, Phillips F, & Fleming RW (2019). Visual perception of shape-transforming processes: ‘Shape Scission’. Cognition, 189, 167-180. https://doi.org/10.1016/j.cognition.2019.04.006
  • Schmidt, F., Hegele, M., & Fleming, R. W. (2017). Perceiving animacy from shape. Journal of Vision, 17(11), 10-10. find paper
  • Van Assen, JJ, Barla P & Fleming, RW (2018). Visual Features in the Perception of Liquids. Current Biology 28(3), 452–458. https://doi.org/10.1016/j.cub.2017.12.037 find paper
  • Vangorp P, Barla, P & Fleming RW (2017). The perception of hazy gloss. Journal of Vision 17(5):19. doi: 10.1167/17.5.19 find paper
  • Zoeller, AC, Lezkan, A, Paulun VC, Fleming RW, K Drewing (2019). Integration of prior knowledge during haptic exploration depends on information type. Journal of Vision 19(4):20. doi: 10.1167/19.4.20. find paper
  • Fleming, R. W. (2014). Visual Perception of Materials and their Properties. Vision Research, 94, 62-75. find paper
  • Fleming, R. W. (2017). Material Perception. Annual Reviews of Vision Science, 3, 8.1–8.24. find paper
  • Muryy, A. A., Fleming, R. W., & Welchman, A. E. (2016). ‘Proto-rivalry’: how the binocular brain identifies gloss. Proceedings of the Royal Society of London B, 283, 20160383. DOI find paper
  • Paulun, V., Schmidt, F., van Assen, J. J. R., & Fleming, R. W. (2017). Shape, motion and optical cues to stiffness of elastic objects. Journal of Vision, 17(1):20, 1-22. DOI find paper
  • Schmidt, F., & Fleming, R. W. (2016). Visual perception of complex shape-transforming processes. Cognitive Psychology, 90, 48-70. DOI find paper
  • Schmidt, F., Hegele, M., & Fleming, R. W. (2017). Perceiving animacy from shape. Journal of Vision, in press. find paper
  • Schmidt, F., Paulun, V. C., van Assen, J. J. R., & Fleming, R. W. (2017). Inferring the stiffness of unfamiliar objects from optical, shape, and motion cues. Journal of Vision, 17(3):18, 1-17. DOI find paper
  • Schmidt, F., Spröte, P., & Fleming, R. W. (2016). Perception of shape and space across rigid transformations. Vision Research, 126, 318-329. DOI find paper
  • Spröte, P., & Fleming, R. W. (2016). Bent out of shape: The visual inference of non-rigid shape transformations applied to objects. Vision Research,126, 330-346. DOI find paper
  • Spröte, P., Schmidt, F., & Fleming, R.W. (2016). Visual perception of shape altered by inferred causal history. Scientific Reports, 6:36245. DOI find paper
  • Van Assen, J. J. R., Barla, P., & Fleming, R. W. (2018). Visual features in the perception of liquids. Current Biology, 28(3), 452-458. find paper
  • Vergne, R., Barla, P., Bonneau, G. P., & Fleming, R. (2016). Flow-Guided Warping for Image-Based Shape Manipulation. ACM Transactions on Graphics (Proceedings of SIGGRAPH), 35(4): 93. DOI find paper
  • van Assen, J. J. R., & Fleming, R. W. (2016). Influence of optical material properties on the perception of liquids. Journal of Vision, 16(15):12, 1–20. DOI find paper

former project-related publications

  • Cholewiak, S.A., Fleming, R.W. and M. Singh (2013). Perception of the physical stability of asymmetrical threedimensional objects. Journal of Vision, 13(4): 12.
  • Doerschner, K. Fleming, R.W., Yilmaz, O., Schrater, P.R., Hartung, B. and Kersten, D. (2011). Visual Motion and the Perception of Surface Material. Current Biology, 21(23): 1-7.
  • Fleming, R. W., D. Holtmann-Rice, and H. H. Bülthoff (2011). Estimation of 3D shape from image orientations. Proceedings of the National Academy of Sciences, 108(51) 20438–20443.
  • Fleming, R. W., Dror, R. O. and E. H. Adelson (2003). Real world illumination and the perception of surface reflectance properties. Journal of Vision, 3(5), 347–368.
  • Fleming, R. W., Torralba, A. and Adelson, E. H. (2004). Specular reflections and the perception of shape. Journal of Vision, 4(9), 798–820.
  • Fleming, R.W. (2012). Dispatch—Human Perception: Visual Heuristics in the Perception of Glossiness. Current Biology, 22(20):R865-R866.
  • Fleming, R.W., Jäkel, F. and L. T. Maloney (2011). Visual Perception of Thick Transparent Materials. Psychological Science, 22(6): 812-820.
  • Muryy, A., Welchman, A.E. and Blake, A and R.W. Fleming (2013). Specular reflections and the estimation of shape from binocular disparity. PNAS, 110(6): 2413-2418.