Attention schema theory

The AST describes how an information-processing machine can claim to have a conscious, subjective experience,{{cite journal |last=Graziano |first=Michael S. A. | name-list-style = vanc |date=2017-11-14|title=The Attention Schema Theory: A Foundation for Engineering Artificial Consciousness |journal=Frontiers in Robotics and AI|volume=4|pages=60|doi=10.3389/frobt.2017.00060 |doi-access=free }} while having no means to discern the difference between its claim and reality.

In the theory, the brain is an information processor captive to the information constructed within it. In this approach, the challenge of explaining consciousness is not, "How does the brain produce an ineffable internal experience," but rather, "How does the brain construct a quirky self description, and what is the useful cognitive role of that self model?"

In other words, because we claim to be conscious, some mechanism in the brain must therefore have computed the requisite information about consciousness to enable the system to output that claim. AST proposes that this is an adaptive function: it serves as an internal model of one of the brain's most important features: attention.

A crucial aspect of the theory is model-based knowledge. The brain constructs rich internal models that lie beneath the level of higher cognition or of language. Cognition has partial access to those internal models, and the content of those models are reported as literal reality.

The AST can be summarized in three broad points:

1. The brain is an information-processing device.
2. The brain has a capacity to focus its processing resources more on some signals than on others. That focus may be on incoming sensory signals or internal information such as recalled memories. This ability is called attention.
3. The brain also builds a set of information, or a representation, descriptive of its own attention. This internal model is the attention schema.

The attention schema allows a machine to make claims about its consciousness. When it claims to be conscious of concept X (to have a subjective awareness or a mental possession of X), the machine is using higher cognition to access an attention schema, and reporting the information therein.

Suppose a person looks at an apple. When the person reports, "I have a subjective experience of that shiny red apple," three items are linked together in that claim: the self, the apple, and a subjective experience.

1. The claim about the presence of a self depends on cognitive access to a self model. Without a self model, and its requisite information, the system would be unable to make claims referencing itself.
2. The claim about the presence of, and properties of, an apple depends on cognitive access to a model of the apple, presumably constructed in the visual system. Again, without the requisite information, the system would be unable to make any claims about the apple or its visual properties.
3. In AST, the claim about the presence of subjective experience depends on cognitive access to an internal model of attention. That internal model does not provide a scientifically precise description of attention, complete with the details of neurons, lateral inhibitory synapses, and competitive signals. The model is silent on the physical mechanisms of attention. Instead, like all internal models in the brain, it is simplified and schematic for the sake of efficiency.

Accessing the information within these three, linked internal models, cognitive machinery claims that there is a self, an apple, and the self has a mental possession of the apple. The mental possession is invisible and has no physically descriptive properties, but it has a general location inside the body and a specific anchor to the apple. This mental essence empowers the self to understand, react to, and remember the apple. The brain (as a machine) relies on its (incomplete and inaccurate) model of attention, claims to have a metaphysical consciousness of the apple.

In the AST, subjective experience (consciousness, or mental possession of a object or experience) is a simplified construct that describes the act of attending to something.

The internal model of attention is not constructed at a higher cognitive level. It is not a cognitive self theory or learned. Instead, it is constructed beneath the level of cognition and is automatic (and necessary), much like the internal model of the apple and the self. The attention schema is a perception-like model of attention, to distinguish it from higher-order cognitive models such as beliefs or intellectually reasoned theories.

This explains how a machine with an attention schema contains the requisite information to claim to have a consciousness of something, whether of an apple, a thought, or of itself. The machine can understand consciousness in the same ways that we do; and on accessing its internal information, it does not find explanatory meta-information, computes a conclusion, or accesses an internal model, but it instead learns only the narrow contents of the internal models. In AST, human are machines of that sort.

AST is consistent with the perspective called illusionism. The term "illusion", however, may have connotations that are not quite apt for this theory. Three issues with that label arise.

1. In the AST, the attention schema is a well-functioning internal model, which is not normally in error. This differs from the common view of an 'illusion' as dismissible or harmful.
2. An illusion is often equated with a mirage, falsely indicating a presence that actually does not exist. If consciousness is an illusion, then by implication nothing real is present behind the illusion. But in the AST, consciousness is a good, if detail-poor, account of attention, which is a physical and mechanistic process emergent from the interactions of neurons. When one claim to be subjectively conscious of something, they are providing a schematized version of the physical reality.
3. An illusion is experienced by some agent. When calling consciousness an illusion, one needs to be careful to define what is meant by "experience" so as to avoid circularity. The AST is not a theory of how the brain has experiences, but rather how a machine can make the claim to have experiences. By being stuck in a logic loop, or captive to its own internal information, an intelligent agent cannot avoid making such a claim.

The central hypothesis in AST is that the brain constructs an internal model of attention, the attention schema. Its primary adaptive function is to enable a better, more flexible control of attention. Two main types of functions have been proposed for the attention schema: control of attention and social cognition.

In the theory of dynamical systems control, a fundamental principle is that a control system works better and more flexibly if it constructs an internal model of the item it controls. An airplane autopilot system works better if it incorporates a model of the dynamics of the airplane. An air and temperature controller for a building works better if it incorporates a rich, predictive model of the building's airflow and temperature dynamics. Similarly, the brain's controller of attention should work better by constructing an internal model of what attention is, how it changes over time, what its consequences are, and what state it is in at any moment.

Thus the brain's controller of attention should incorporate an internal model of attention – a set of information that is continuously updated and that reflects the dynamics and the changing state of attention. Since attention is one of the most pervasive and important processes in the brain, the proposed attention schema, helping to control attention, would be of fundamental importance to the system.

A growing set of behavioral evidence supports this hypothesis. When subjective awareness of a visual stimulus is absent, people can still direct attention to that stimulus, but that attention loses some aspects of control. It is less stable over time, and is less adaptable given training on perturbations.{{cite journal | vauthors = Webb TW, Kean HH, Graziano MS | title = Effects of Awareness on the Control of Attention | journal = J Cogn Neurosci | volume = 28 | issue = 6 | pages = 842–51 | year = 2016 | pmid = 26836517 | doi = 10.1162/jocn_a_00931 | s2cid = 9378474 | url = https://www.princeton.edu/~graziano/Webb_Graziano_reprint_2016.pdf}} Initial experiments suggest that this may be true, and support the proposal that awareness acts like the internal model for the control of attention.

A second proposed function of an attention schema is for social cognition – using the attention schema to model the attentional states of others as well as of ourselves.{{cite book| first = Michael S. A. | last = Graziano | name-list-style = vanc |author-link1= Michael Graziano | title=Consciousness and the Social Brain|url=https://books.google.com/books?id=Ta4eAAAAQBAJ&pg=PP1|date=19 September 2013|publisher=OUP USA|isbn=978-0-19-992864-4}} In effect, just as humans attribute awareness to themselves, it is also attributed to others.

An advantage of this use of an attention schema is in behavioral prediction, which can aid in the survival of intelligent social agents. This is because an agent's attention influences its behavior, since what it is attending to, they are likely to behave toward (and vice-versa). An internal model of attention, and its dynamics and consequences, would be useful for predicting behavior.

An intelligent agent can also plan its own future partly by predicting their own actions.

Research into AST therefore focuses on the overlap between one's own claims of awareness and one's attributions of awareness to others. Initial research using brain scanning in humans suggests that both processes recruit cortical networks that converge on the temporoparietal junction.{{cite journal |vauthors=Kelly YT, Webb TW, Meier JD, Arcaro MJ, Graziano MS |year=2014 |title=Attributing awareness to oneself and to others |url=http://www.princeton.edu/~graziano/Kelly_Graziano_2014.pdf |journal=Proc. Natl. Acad. Sci. U.S.A. |volume=111 |issue=13 |pages=5012–7 |bibcode=2014PNAS..111.5012K |doi=10.1073/pnas.1401201111 |pmc=3977229 |pmid=24639542 |doi-access=free}}{{cite journal |vauthors=Webb TW, Igelström KM, Schurger A, Graziano MS |year=2016 |title=Cortical networks involved in visual awareness independent of visual attention |journal=Proc. Natl. Acad. Sci. U.S.A. |volume=113 |issue=48 |pages=13923–13928 |bibcode=2016PNAS..11313923W |doi=10.1073/pnas.1611505113 |pmc=5137756 |pmid=27849616 |doi-access=free}}

AST was developed in analogy to the psychological and neuroscientific work on the body schema, an area of research to which Graziano contributed heavily in his previous publications. In this section, the central ideas of AST are explained by use of the analogy to the body schema.

Suppose a person, Kevin, has reached out and grasped an apple, and is asked what he is holding. He can say that the object is an apple, and can describe its properties. This is because Kevin's brain has constructed a schematic description of the apple, here called an internal model. This internal model is a set of information, about size, color, shape, and location, that is constantly updated as new signals are processed. This model allows Kevin's brain to react to the apple and even predict how it may behave in different circumstances.

Kevin's brain has constructed an apple schema. His cognitive and linguistic processors can access this internal model of an apple, and thus he can answer questions about it.

Now Kevin is asked, "How are you holding the apple? What is your physical relationship to the apple?" Once again Kevin can answer.

The reason is that, in addition to an internal model of the apple, Kevin's brain also constructs an internal model of his body, including his arm and hand. This internal mode (the body schema), is a set of information which is constantly updated as new signals are processed, about the size and shape of Kevin's limbs, how they are hinged, how they tend to move, their state at each moment and in the near future.

The primary purpose of this body schema is to allow Kevin's brain to control movement. Because he knows the state that his arm is in, he can better guide its movement. A side effect of this internal body schema is that he can explicitly talk about his body. His cognitive and linguistic processors can access this body schema, and therefore Kevin can answer, "I am grasping the apple with my hand, while my arm is outstretched."

However the body schema is limited. If Kevin is asked, "How many muscles are in your arm? Where do they attach to the bones?" he cannot answer based on his body schema. He may have intellectual knowledge learned from a book, but he has no immediate insight into the muscles of his particular arm. The body schema is a reduced model which lacks that level of mechanistic detail.

AST takes this analysis one step further, and includes Kevin's ability to pay attention to the apple, in addition to physically grasping it.

AST's definition of attention means that Kevin's brain has focused processing resources on the apple. The internal model of the apple has been 'boosted in strength', and as a result Kevin's brain processes the apple deeply, is more likely to store it in memory, or to trigger a response to it. In this definition, attention is a mechanistic, data-handling process. It involves a relative deployment of processing resources to a specific signal.

Now if Kevin is asked, "What is your mental relationship to the apple?", he can answer this question too. According to AST, this is because Kevin's brain constructs not only an internal model of the apple and his body, but also an internal model of his attention. This attention schema is a set of information describing what attention is, its basic properties, dynamics, consequences, and its state at a particular moment. Kevin's cognitive and linguistic machinery has access to this internal model, and therefore Kevin can describe his mental relationship to the apple. However, just as in the case of the body schema, the attention schema lacks information about its mechanistic details. It does not contain information about neurons, synapses, or electrochemical signals that make attention possible. As a result, Kevin reports an experience lacking clear physical attributes. He says, "I have a mental grasp of the apple. That mental possession, in and of itself, has no physical properties. It just is. It's vaguely located inside me. It is what allows me to know about that apple, remember it, and react to it. It's my mental self taking hold of the apple – my experience of the apple."

Here Kevin describes a subjective, experiential consciousness of the apple, which seems (from his point of view) to transcend any physical mechanism. Again, this is only because it is an incomplete description of the physical reality: Kevin's account of his consciousness is a simplified, schematic description of his state of attention.

The example given above relates to a consciousness of an apple. The same reasoning can be applied to other concepts, such as consciousness of a sound, a memory, or oneself as a whole.

• Integrated information theory of consciousness
• Global workspace theory of consciousness

{{Reflist|30em}}

{{refbegin|30em}}

• {{cite journal | vauthors = Graziano MS, Kastner S | author-link1= Michael Graziano | title = Human consciousness and its relationship to social neuroscience: A novel hypothesis | journal = Cogn Neurosci | volume = 2 | issue = 2 | pages = 98–113 | date = January 2011 | pmid = 22121395 | pmc = 3223025 | doi = 10.1080/17588928.2011.565121 }}
• {{cite book | author = Michael S. A. Graziano | author-link1= Michael Graziano | title = Consciousness and the Social Brain | url = https://books.google.com/books?id=Ta4eAAAAQBAJ&pg=PP1 | date = 19 September 2013 | publisher = OUP USA | isbn = 978-0-19-992864-4}}
• {{cite journal | vauthors = Webb TW, Graziano MS | title = The attention schema theory: a mechanistic account of subjective awareness | journal = Front Psychol | volume = 6 | pages = 500 | year = 2015 | pmid = 25954242 | pmc = 4407481 | doi = 10.3389/fpsyg.2015.00500 | doi-access = free }}
• {{cite book | last1 = Graziano | first1 = M.S.A. | last2 = Webb | first2 = T.W. | name-list-style = vanc |author-link1= Michael Graziano | title = Evolution of Nervous Systems | chapter = From Sponge to Human: The Evolution of Consciousness | year = 2017 | pages = 547–554 | doi = 10.1016/B978-0-12-804042-3.00098-1 | chapter-url = https://www.princeton.edu/~graziano/evolution_of_consciousness_2017.pdf | isbn = 9780128040966}}
• {{cite journal | vauthors = Graziano MS, Guterstam A, Bio BJ, Wilterson AI | author-link1= Michael Graziano| title = Toward a standard model of consciousness: Reconciling the attention schema, global workspace, higher-order thought, and illusionist theories | journal = Cogn Neuropsychol | pages = 155–172 | date = September 2019 | volume= 37| issue= 3–4| pmid = 31556341 | doi = 10.1080/02643294.2019.1670630 | s2cid= 203441429}}
• {{cite book | author = Michael S. A. Graziano | author-link1= Michael Graziano | title = Rethinking Consciousness: A Scientific Theory of Subjective Experience | url = https://books.google.com/books?id=vvaKDwAAQBAJ | date = 17 September 2019 | publisher = W. W. Norton | isbn = 978-0-393-65262-8}}

{{refend}}

• [https://aeon.co/essays/how-consciousness-works-and-why-we-believe-in-ghosts How Consciousness Works. And Why We Believe in Ghosts (21 August 2013) – Michael Graziano – Aeon]
• [http://www.huffingtonpost.com/michael-graziano/consciousness-and-the-una_b_3844493.html Consciousness and the Unashamed Rationalist (30 August 2013) – Michael Graziano – HuffPost]
• [https://www.nytimes.com/2014/10/12/opinion/sunday/are-we-really-conscious.html Are We Really Conscious? (10 October 2014) – Michael Graziano – The New York Times]
• [https://aeon.co/essays/can-we-make-consciousness-into-an-engineering-problem Can We Make Consciousness into an Engineering Problem? (10 July 2015) – Michael Graziano – Aeon]
• [http://thepsychreport.com/science/rethinking-consciousness-a-qa-with-michael-graziano/ Rethinking Consciousness: A Q&A with Michael Graziano (29 July 2015) – Evan Nesterak & Michael Graziano – The Psych Report] {{Webarchive|url=https://web.archive.org/web/20191231214325/http://thepsychreport.com/science/rethinking-consciousness-a-qa-with-michael-graziano/ |date=31 December 2019 }}
• [http://brainworldmagazine.com/consciousness-dr-michael-graziano-attention-schema-theory/ What is Consciousness? Dr. Michael Graziano on Attention Schema Theory (4 February 2018) – Isabel Pastor Guzman & Michael Graziano – Brain World]

{{Consciousness}}

Category:Attention

Category:Consciousness

Category:Psychological theories