Object and Scene Memory

How detailed is our visual memory for naturalistic scenes?

Even though our memory of the visual world is not a one-to-one imprint of what meets our eyes, we seem to be able to detect small changes in naturalistic scenes. How detailed is the information that we can store from one glimpse of a scene to another? How do changes to objects in scenes affect eye movement control? We have found evidence that quite detailed episodic scene representations can be generated when merely inspecting naturalistic scenes. When observers encountered small deviations from these episodically learnt scene representations, a slightly moved object led to increased attentional allocation, i.e. more and longer fixations to the changed object as well as its prior location regardless of whether this change was explicitly noticed (Võ, Zwickel, & Schneider, 2010). Even object representations that were created incidentally while fixating distractors during search seem to be stored in episodic memory (Võ, Schneider, & Matthias, 2008).

Võ, M. L.-H., Zwickel, J., & Schneider, W. X. (2010). Has Someone Moved My Plate? The Immediate and Persistent Effects Of Object Location Changes On Gaze Allocation During Natural Scene Viewing. Attention, Perception & Psychophysics, 72 (5), 1251-1255. doi: doi.org/10.3758/APP.72.5.1251 pdf

 

Võ, M. L.-H., Schneider, W. X., & Matthias, E. (2008). Transsaccadic Scene Memory Revisited: A ‘Theory of Visual Attention (TVA)’ based Approach to Recognition Memory and Confidence for Objects in Naturalistic Scenes. Journal of Eye-Movement Research, 2(2):7, 1-13.
doi: doi.org/10.16910/jemr.2.2.7 pdf


What “EPISODIC” SCENE MEMORIES ARE CREATED AND HOW DO THESE INTERACT WITH THE SCENE SCHEMA REPRESENTATIONS STORED IN LONG-TERM MEMORY?

Interestingly, despite being able to generate very detailed episodic memory representations, these do not necessarily help when searching for different objects in the same scene. In the image above, fixation-based heatmaps show which parts of the scene people inspected when searching for the jam jar. Observers who had never seen the scene before (EXP1) examined the same locations as observers who had previewed and memorized the scene for 30 s (EXP4). As long as objects within a scene are located in probable locations, general scene knowledge is preferentially used to guide object search. Episodic memory, however, dominates search guidance when the same object is searched for a second time or when objects are mislocated, rendering general scene knowledge useless (Võ & Wolfe, in press). 

Võ, M. L.-H., & Wolfe, J. M. (2015). The role of memory for visual search in scenes.

Annals of the New York Academy of Sciences, 339(1), 72-81

doi: doi.org/10.1111/nyas.1266 pdf

 

Võ, M. L.-H., & Wolfe, J. M. (2013). The interplay of episodic and semantic memory in guiding repeated search in scenes. Cognition, 126(2), 198-212.
doi: doi.org/10.1016/j.cognition.2012.09.017 pdf

 

Võ, M. L.-H., & Wolfe, J. M. (2012). When does repeated search in scenes involve memory? Looking at versus looking for objects in scenes. Journal of Experimental Psychology: Human Perception and Performance, 38(1), 23-41. doi: doi.org/10.1037/a0024147 pdf

 

Võ, M. L.-H., & Wolfe, J. M., (2010). The Role of Incidental Object Fixations in Repeated Search: Looking AT versus looking FOR an object in a scene. Object Perception, Attention, and Memory (OPAM) 2010 Conference Report, Visual Cognition, 18(10), 1486 – 1541.

 

Brockmole, J. R., & Võ, M. L.-H. (2010). Semantic Memory and the Learning of  Contextual Regularities Within Real-World Scenes. Attention, Perception, & Psychophysics, 72, 1803-1813. doi: doi.org/10.3758/APP.72.7.1803 pdf