Memory Influences Visual Cognition across Multiple Functional States of Interactive Cortical Dynamics

Abstract

Memory supports a wide range of abilities from categorical perception to goal-directed behavior, such as decision-making and episodic recognition. Memory activates fast and surprisingly accurately and even when information is ambiguous or impoverished (i.e., showing object constancy). This paper proposes the multiple-state interactive (MUSI) account of object cognition that attempts to explain how sensory stimulation activates memory across multiple functional states of neural dynamics, including automatic and strategic mental simulation mechanisms that can ground cognition in modal information processing. A key novel postulate of this account is ‘multiple-function regional activity’: The same neuronal population can contribute to multiple brain states, depending upon the dominant set of inputs at that time. In state 1, the initial fast bottom-up pass through posterior neocortex happens between 95 ms and ~200 ms, with knowledge supporting categorical perception by 120 ms. In state 2, starting around 200 ms, a sustained state of iterative activation of object-sensitive cortex involves bottom-up, recurrent, and feedback interactions with frontoparietal cortex. This supports higher cognitive functions associated with decision-making even under ambiguous or impoverished conditions, phenomenological consciousness, and automatic mental simulation. In the latest state so far identified, state M, starting around 300 to 500 ms, large-scale cortical network interactions, including between multiple networks (e.g., control, salience, and especially default mode), further modulate posterior cortex. This supports elaborated cognition based on earlier processing, including episodic memory, strategic mental simulation, decision evaluation, creativity, and access consciousness. Convergent evidence is reviewed from cognitive neuroscience of object cognition, decision-making, memory, and mental imagery that support this account and define the brain regions and time course of these brain dynamics.