Human observers have been demonstrated to be sensitive to the local (physical) light field, or more precisely, to the primary direction, intensity, and diffuseness of the light at a point in a space. In the present study we focused on the question of whether it is possible to reconstruct the global visual light field, based on observers' inferences of the local light properties. Observers adjusted the illumination on a probe in order to visually fit it in three diversely lit scenes. For each scene they made 36 settings on a regular grid. The global structure of the first order properties of the light field could then indeed be reconstructed by interpolation of light vectors coefficients representing the local settings. We demonstrate that the resulting visual light fields (individual and averaged) can be visualized and we show how they can be compared to physical measurements in the same scenes. Our findings suggest that human observers have a robust impression of the light field that is simplified with respect to the physical light field. In particular, the subtle spatial variations of the physical light fields are largely neglected and the visual light fields were more similar to simple diverging fields than to the actual physical light fields.