C1
Prof. Dr. Fleming

Visual Categorization and Prediction of Deformable Materials

Planned research

We seek to understand the categorization of deformable materials, like liquid or cloth. Using simulated materials, we will measure how category learning generalizes to novel samples, and test whether subjects can predict the future movements of deformable materials as they interact with other objects. Finally we will model human categorization using machine learning techniques, based on analysis of the 3D shapes of the simulated materials.  We hypothesize that observers learn generative models of the ‘typical appearance’ of materials, enabling categorization and prediction.

Current research

Using simulated materials, we will measure how category learning generalizes to novel samples, and test whether subjects can predict the future movements of deformable materials as they interact with other objects. Finally we will model human categorization using machine learning techniques, based on analysis of the 3D shapes of the simulated materials.  We hypothesize that observers learn generative models of the ‘typical appearance’ of materials, enabling categorization and prediction.

 

 

new project-related publications
Fleming RW & Schmidt F (2019). Getting ‘‘fumpered’’: Classifying objects by what has been done to them. Journal of Vision, 19(4):15 find paper DOI
Kunsberg B, Holtmann-Rice D, Alexander E, Cholewiak S, Fleming RW, Zucker SW. (2018). Colour, contours, shading and shape: flow interactions reveal anchor neighbourhoods. Interface Focus 8: 20180019. find paper
Maiello G, Paulun VC, Klein LK, & Fleming RW. (2018). The Sequential-Weight Illusion. i-Perception, 9(4), 1–6. find paper DOI
Maiello, G., Paulun, V. C., Klein, L. K., & Fleming, R. W. (2019). Object visibility, not energy expenditure, accounts for spatial biases in human grasp selection. i-Perception. find paper DOI
Paulun VC, Buckingham G, Goodale MA & Fleming RW (2019). The Material-Weight Illusion disappears or inverts in objects made of two materials. Journal of Neurophysiology. 121: 996–1010. find paper DOI
Schmidt F & Fleming RW (2018). Identifying shape transformations from photographs of real objects. PLoS ONE 13(8): e0202115. find paper DOI
Schmidt F, Phillips F, & Fleming RW (2019). Visual perception of shape-transforming processes: ‘Shape Scission’. Cognition, 189, 167-180. find paper DOI
Van Assen, JJ, Barla P & Fleming, RW (2018). Visual Features in the Perception of Liquids. Current Biology 28(3), 452–458. find paper
Fleming, R. W., & Storrs, K. R. (2019). Learning to see stuff. Current Opinion in Behavioral Sciences, 30, 100-108. find paper
Klein, L. K., Maiello, G., Fleming, R. W., & Voudouris, D. (2021). Friction is preferred over grasp configuration in precision grip grasping. Journal of Neurophysiology, 2021-02. find paper.
Klein, L. K., Maiello, G., Paulun, V. C., & Fleming, R. W. (2020). Predicting precision grip grasp locations on three-dimensional objects. PLoS Computational Biology, 16(8): e1008081. find paper
Morgenstern, Y., Hartmann, F., Schmidt, F., Tiedemann, H., Prokott, E., Maiello, G., & Fleming, R. W. (2021). An image-computable model of human visual shape similarity.PLOS Computational Biology, 17(6), e1008981. find paper. DOI
Morgenstern, Y., Schmidt, F., & Fleming, R. W. (2019). One-shot categorization of novel object classes in humans. Vision research, 165, 98-108. find paper DOI
Morgenstern, Y., Schmidt, F., & Fleming, R. W. (2020). A dataset for evaluating one-shot categorization of novel object classes. Data in brief, 29, 105302. DOI
Paulun, V. C., & Fleming, R. W. (2020). Visually inferring elasticity from the motion trajectory of bouncing cubes. Journal of Vision, 20(6), 6-6. find paper DOI
Paulun, V. C., Buckingham, G., Goodale, M. A., & Fleming, R. W. (2019). The Material-Weight Illusion disappears or inverts in objects made of two materials. Journal of Neurophysiology. 121: 996-1010 find paper
Paulun, V.C., & Fleming, R.W., (2020). Visually Inferring Elasticity from the Motion Trajectory of Bouncing Cubes. Journal of Vision. 20(6), 6-6. find paper
Phillips, F. & Fleming, R. W. (2020). The Veiled Virgin illustrates visual segmentation of shape by cause. Proceedings of the National Academy of Sciences, 117 (21), 11735-11743. find paper
Schmidt, F. (2020). The art of shaping materials. Art & Perception, 1(aop), 1-27. find paper
Schmidt, F., Fleming, R. W., & Valsecchi, M. (2020). Softness and weight from shape: Material properties inferred from local shape features. Journal of Vision, 20(6), 2-2. find paper DOI
Schmidt, F., Kleis, J., Morgenstern, Y., & Fleming, R. W. (2020). The role of semantics in the perceptual organization of shape. Scientific Reports, 10/, 22141. find paper.
Storrs, K. R., & Fleming, R. W. (2021). Learning about the world by learning about images. Current Directions in Psychological Science. (in press.)
Toscani, M., Milojevic, Z., Fleming, R. W., & Gegenfurtner, K. R. (2020). Color consistency in the appearance of bleached fabrics. Journal of Vision, 20(4), 11-11. find paper
Van Assen, J. J. R., Barla, P., & Fleming, R. W. (2018). Visual features in the perception of liquids. Current Biology, 28(3), 452-458. find paper DOI
Van Assen, J. J. R., Nishida, S., & Fleming, R. W. (2020). Visual perception of liquids: Insights from deep neural networks. PLoS Computational Biology, 16(8): e1008018. find paper
Zoeller, A. C., Lezkan, A., Paulun, V. C., Fleming, R. W., & Drewing, K. (2019). Integration of prior knowledge during haptic exploration depends on information type. Journal of vision, 19(4), 20-20. find paper DOI
former project-related publications
Schmidt, F., Hegele, M., & Fleming, R. W. (2017). Perceiving animacy from shape. Journal of Vision, 17(11), 10-10. find paper
Vangorp P, Barla, P & Fleming RW (2017). The perception of hazy gloss. Journal of Vision 17(5):19. doi: 10.1167/17.5.19 find paper
Cholewiak, S.A., Fleming, R.W. and M. Singh (2013). Perception of the physical stability of asymmetrical threedimensional objects. Journal of Vision, 13(4): 12.
Doerschner, K. Fleming, R.W., Yilmaz, O., Schrater, P.R., Hartung, B. and Kersten, D. (2011). Visual Motion and the Perception of Surface Material. Current Biology, 21(23): 1-7.
Fleming, R. W. (2014). Visual Perception of Materials and their Properties. Vision Research, 94, 62-75. find paper
Fleming, R. W. (2017). Material Perception. Annual Reviews of Vision Science, 3, 8.1–8.24. find paper
Fleming, R. W., D. Holtmann-Rice, and H. H. Bülthoff (2011). Estimation of 3D shape from image orientations. Proceedings of the National Academy of Sciences, 108(51) 20438–20443.
Fleming, R. W., Dror, R. O. and E. H. Adelson (2003). Real world illumination and the perception of surface reflectance properties. Journal of Vision, 3(5), 347–368.
Fleming, R. W., Torralba, A. and Adelson, E. H. (2004). Specular reflections and the perception of shape. Journal of Vision, 4(9), 798–820.
Fleming, R.W. (2012). Dispatch—Human Perception: Visual Heuristics in the Perception of Glossiness. Current Biology, 22(20):R865-R866.
Fleming, R.W., Jäkel, F. and L. T. Maloney (2011). Visual Perception of Thick Transparent Materials. Psychological Science, 22(6): 812-820.
Muryy, A. A., Fleming, R. W., & Welchman, A. E. (2016). ‘Proto-rivalry’: how the binocular brain identifies gloss. Proceedings of the Royal Society of London B, 283, 20160383. DOI find paper
Muryy, A., Welchman, A.E. and Blake, A and R.W. Fleming (2013). Specular reflections and the estimation of shape from binocular disparity. PNAS, 110(6): 2413-2418.
Paulun, V., Schmidt, F., van Assen, J. J. R., & Fleming, R. W. (2017). Shape, motion and optical cues to stiffness of elastic objects. Journal of Vision, 17(1):20, 1-22. DOI find paper
Schmidt, F., & Fleming, R. W. (2016). Visual perception of complex shape-transforming processes. Cognitive Psychology, 90, 48-70. DOI find paper
Schmidt, F., Hegele, M., & Fleming, R. W. (2017). Perceiving animacy from shape. Journal of Vision, in press. find paper
Schmidt, F., Paulun, V. C., van Assen, J. J. R., & Fleming, R. W. (2017). Inferring the stiffness of unfamiliar objects from optical, shape, and motion cues. Journal of Vision, 17(3):18, 1-17. DOI find paper
Schmidt, F., Spröte, P., & Fleming, R. W. (2016). Perception of shape and space across rigid transformations. Vision Research, 126, 318-329. DOI find paper
Spröte, P., & Fleming, R. W. (2016). Bent out of shape: The visual inference of non-rigid shape transformations applied to objects. Vision Research,126, 330-346. DOI find paper
Spröte, P., Schmidt, F., & Fleming, R.W. (2016). Visual perception of shape altered by inferred causal history. Scientific Reports, 6:36245. DOI find paper
van Assen, J. J. R., & Fleming, R. W. (2016). Influence of optical material properties on the perception of liquids. Journal of Vision, 16(15):12, 1–20. DOI find paper
Vergne, R., Barla, P., Bonneau, G. P., & Fleming, R. (2016). Flow-Guided Warping for Image-Based Shape Manipulation. ACM Transactions on Graphics (Proceedings of SIGGRAPH), 35(4): 93. DOI find paper