Andrew Barto

Andrew Gehret Barto was born in either 1948 or 1949.{{Cite news |date=March 5, 2025 |title=Andrew Barto and Richard Sutton, pioneers in field of reinforcement learning, win AM Turing Award |url=https://www.telegraphindia.com/world/andrew-barto-and-richard-sutton-pioneers-in-field-of-reinforcement-learning-win-am-turing-award/cid/2087240 |access-date=March 10, 2025 |work=The Telegraph |quote=Research that Barto, 76, and Sutton, 67, began in the late 1970s paved the way for some of the past decade's AI breakthroughs.}} He received his B.S. with distinction in mathematics from the University of Michigan in 1970, after having initially majored in naval architecture and engineering. After reading work by Michael Arbib, Warren Sturgis McCulloch, and Walter Pitts, he became interested in using computers and mathematics to model the brain, and five years later was awarded a Ph.D. in computer science for a thesis on cellular automata.{{cite web |date=January 7, 2022 | title = Virtual History Interview |url=https://www.youtube.com/watch?v=MEsTejZkcx8 |accessdate=September 6, 2022 | publisher=International Neural Network Society}}

In 1977, Barto joined the College of Information and Computer Sciences at the University of Massachusetts Amherst as a postdoctoral research associate, was promoted to associate professor in 1982, and full professor in 1991. He was department chair from 2007 to 2011 and a core faculty member of the Neuroscience and Behavior program.{{cite web |date=February 17, 2008 |title=Andrew G. Barto |url=https://www.cics.umass.edu/faculty/directory/barto_andrew |url-status=dead |archive-url=https://web.archive.org/web/20201128195125/https://www.cics.umass.edu/faculty/directory/barto_andrew |archive-date=November 28, 2020 |accessdate=October 18, 2020 |publisher=University of Massachusetts Amherst}}

During this time at UMass, Barto co-directed the Autonomous Learning Laboratory (initially the Adaptive Network Laboratory), which generated several key ideas in reinforcement learning. Richard Sutton, with whom he co-authored the influential book Reinforcement Learning: An Introduction (MIT Press 1998; 2nd edition 2018), was his PhD student.

When Barto started at UMass, he joined a group of researchers trying to explore the behavior of neurons in the human brain as the basis for human intelligence, a concept that had been advanced by computer scientist A. Harry Klopf. Barto was joined by his doctoral student, Sutton in using mathematics toward furthering the concept and using it as the basis for artificial intelligence. This concept became known as reinforcement learning and went on to becoming a key part of artificial intelligence techniques.

Barto and Sutton used Markov decision processes (MDP) as the mathematical foundation to explain how agents (algorithmic entities) made decisions when in a stochastic or random environment, receiving rewards at the end of every action. Traditional MDP theory assumed the agents knew all information about the MDPs in their attempt toward maximizing their cumulative rewards. Barto and Sutton's reinforcement learning techniques allowed for both the environment and the rewards to be unknown, and thus allowed for these category of algorithms to be applied to a wide array of problems.{{Cite web |title=A.M. Turing Award |url=https://amturing.acm.org/ |access-date=March 8, 2025 |website=amturing.acm.org}}

Barto built a lab in UMass Amherst toward developing the ideas on reinforcement learning while Sutton returned to Canada. Reinforcement learning as a topic continued to develop in academic circles until one of its first major real world applications saw Google's AlphaGo program built on this concept defeating the then prevailing human champion.{{Cite news |last=Metz |first=Cade |date=March 5, 2025 |title=Turing Award Goes to 2 Pioneers of Artificial Intelligence |url=https://www.nytimes.com/2025/03/05/technology/turing-award-andrew-barto-richard-sutton.html |access-date=March 8, 2025 |work=The New York Times |language=en-US |issn=0362-4331}} Barto and Sutton have widely been credited and accepted as pioneers of modern reinforcement learning, with the technique itself being foundational to the modern AI boom.{{Cite web |date=March 5, 2025 |title=AI pioneers Andrew Barto and Richard Sutton win 2025 Turing Award for groundbreaking contributions to reinforcement learning {{!}} NSF – National Science Foundation |url=https://www.nsf.gov/news/ai-pioneers-andrew-barto-richard-sutton-win-2025-turing |access-date=March 8, 2025 |website=www.nsf.gov |language=en}}

Barto published over one hundred papers or chapters in journals, books, and conference and workshop proceedings. He is co-author with Richard Sutton of the book Reinforcement Learning: An Introduction, MIT Press 1998 (2nd edition 2018), and co-editor with Jennie Si, Warren Powell, and Don Wunch II of the Handbook of Learning and Approximate Dynamic Programming, Wiley-IEEE Press, 2004.[https://www.cs.umass.edu/csinfo/faculty-bios/barto.html UMass Amherst: Department of Computer Science] {{webarchive|url=https://web.archive.org/web/20060902071948/http://www.cs.umass.edu/csinfo/faculty-bios/barto.html|date=September 2, 2006}}

Barto is a Fellow of the American Association for the Advancement of Science, a Fellow and Senior Member of the IEEE,{{cite web|url=https://www.umass.edu/newsoffice/article/barto-elected-ieee-fellow|title=Barto elected IEEE fellow|publisher=University of Massachusetts Amherst|date=November 22, 2005|accessdate=December 3, 2019|archive-date=December 3, 2019|archive-url=https://web.archive.org/web/20191203015122/https://www.umass.edu/newsoffice/article/barto-elected-ieee-fellow|url-status=dead}} and a member of the American Association for Artificial Intelligence and the Society for Neuroscience.{{Cite web |title=CMU CS – AI Seminar |url=https://www.cs.cmu.edu/~aiseminar/past/aiseminar97.html#Andy%20Barto |access-date=March 7, 2025 |website=www.cs.cmu.edu}}

Barto was awarded the UMass Neurosciences Lifetime Achievement Award in 2019, the IEEE Neural Network Society Pioneer Award in 2004,{{cite web | date = September 6, 2022 | title= "IEEE Computational Intelligence Society Past Recipients" | url = https://cis.ieee.org/awards/past-recipients | accessdate=September 6, 2022}} and the IJCAI Award for Research Excellence in 2017. His citation for the latter read: "Professor Barto is recognized for his groundbreaking and impactful research in both the theory and application of reinforcement learning."

In 2025, he received the Turing Award from the Association for Computing Machinery together with his former doctoral student Richard S. Sutton for their work on reinforcement learning; the citation of the award read: "For developing the conceptual and algorithmic foundations of reinforcement learning."{{Cite web |date=March 5, 2025 |title=Turing Awardees – Directorate for Computer and Information Science and Engineering (CISE) {{!}} NSF – National Science Foundation |url=https://www.nsf.gov/cise/turing-awardees#2020-present-aa3 |access-date=March 8, 2025 |website=www.nsf.gov |language=en}}

{{Reflist}}

• {{GoogleScholar|CMIgrCgAAAAJ}}
• {{Official website|http://www-all.cs.umass.edu/~barto/}}

{{Turing award}}

{{Authority control}}

{{DEFAULTSORT:Barto, Andrew}}

Category:1940s births

Category:Living people

Category:University of Michigan alumni

Category:University of Massachusetts Amherst faculty

Category:Fellows of the American Association for the Advancement of Science

Category:Fellows of the IEEE

Category:Artificial intelligence researchers

Category:Place of birth missing (living people)

Category:American computer scientists

Category:21st-century American scientists

Category:20th-century American scientists

Category:Turing Award laureates

Category:Year of birth missing (living people)