Rapid Scene Understanding

Global and local scene features as well as prior knowledge of where objects are most probably found in scenes seem to enable us to rapidly narrow down search space during scene viewing. What information from an initial glimpse guides our search and what is the time course of this initial scene processing for the purpose of object search?I have used a number of experimental paradigms to study the workings of “scene guidance”. For example, the "flash-preview moving-window” paradigm (Castelhano & Henderson, 2007; Võ & Henderson, 2010, 2011) combines a brief, tachistoscopic viewing method (typically used in scene categorization experiments) with the moving window technique (typically used in reading studies). First, a masked scene preview is briefly flashed followed by a word indicating the identity of the target. Now, when the search scene reappears, it is only visible through a small, gaze-contingent moving window centered at each fixation. This paradigm allows us to selectively manipulate the information provided by the preview of the scene. Manipulating preview content and duration shows that even an incomplete preview of a scene (no objects/no background) can benefit search with the degree of benefit depending on individual differences in general processing speed (Võ & Schneider, 2010). Even a 50 ms glimpse of a scene can guide search as long as sufficient time is subsequently available to combine prior knowledge with visual input (Võ & Henderson, 2010).

Wiesmann, Sandro L., Caplette, L., Willenbockel, V., Gosselin, F. & Võ , M L.-H. (2021).

Flexible time course of spatial frequency use during scene categorization. Scientific Reports, 11(1), 1-13. doi: doi.org/10.1038/s41598-021-93252-2 pdf

 

Võ, M. L. H., & Henderson, J. M. (2011). Object–scene inconsistencies do not capture gaze: evidence from the flash-preview moving-window paradigm. Attention, Perception, & Psychophysics73, 1742-1753. doi: doi.org/10.3758/s13414-011-0150-6 pdf

 

Võ, M. L. H., & Henderson, J. (2010). The time course of initial scene processing for guidance of eye movements when searching natural scenes. Journal of Vision10(3), 1-13.

 

Võ, M. L.-H. & Schneider, W. X. (2010). A Glimpse Is Not A Glimpse: Differential Processing of Flashed Scene Previews Leads to Differential Target Search Benefits. Visual Cognition18(2). 171-200. doi: doi.org/10.1080/13506280802547901 pdf