artificial imagination
{{Short description|Artificial simulation of human imagination}}
{{distinguish|Hallucination (artificial intelligence)}}
Artificial imagination is a narrow subcomponent of artificial general intelligence which generates, simulates, and facilitates{{cite arXiv| title=Improving Multimodal Interactive Agents with Reinforcement Learning from Human Feedback| author1=Abramson, J.| author2=Ahuja, A| author3=Carnevale, F.| pages=26| date=21 November 2022| class=cs.LG| eprint=2211.11602}} real or possible fiction models to create predictions, inventions,{{cite arXiv| title=Physical Design using Differentiable Learned Simulators| author1=Allen, K.R.| author2=Lopez-Guevara, T.| author3=Stachenfeld, K.| author4=Sanchez-Gonzalez, A.| author5=Battaglia, P.| author6=Hamrick, J.| author7=Pfaff, T.| date=1 February 2022| class=cs.LG| eprint=2202.00728}} or conscious experiences.
The term artificial imagination is also used to describe a property of machines or programs. Some of the traits that researchers hope to simulate include creativity, vision, digital art, humor, and satire.{{Cite news|date=2023-06-16|title=How Generative AI Can Augment Human Creativity|work=Harvard Business Review|url=https://hbr.org/2023/07/how-generative-ai-can-augment-human-creativity|access-date=2023-06-20|issn=0017-8012}}
Practitioners in the field are researching various aspects of Artificial imagination, such as Artificial (visual) imagination,{{cite book| chapter=Visual information retrieval using synthesized imagery| last1=Thomee |first1=B.| last2=Huiskes |first2=M.J.|last3=Bakker |first3=E.| last4=Lew |first4=M.S.| title=Proceedings of the 6th ACM international conference on Image and video retrieval| chapter-url=https://dl.acm.org/doi/abs/10.1145/1282280.1282303?download=true| publisher=ACM| pages=127–130| date=July 2007| access-date=19 December 2023| doi=10.1145/1282280.1282303| isbn=9781595937339| s2cid=11199318}} Artificial (aural) Imagination,Audio Content Transmission by Xavier Amatriain & Perfecto Herrera, {{cite web
|url=http://www.iua.upf.es/mtg/publications/dafx2001-xamat.pdf
|title=Publications
|access-date=2007-12-22
|url-status=dead
|archive-url=https://web.archive.org/web/20070106033332/http://www.iua.upf.es/mtg/publications/dafx2001-xamat.pdf
|archive-date=2007-01-06
}}
modeling/filtering content based on human emotions and Interactive Search. Some articles on the topic speculate on how artificial imagination may evolve to create an artificial world "people may be comfortable enough to escape from the real world".Hypertext and “the Hyperreal” by Stuart Moulthrop, Yale University http://portal.acm.org/citation.cfm?doid=74224.74246
Some researchers such as G. Schleis and M. Rizki have focused on using artificial neural networks to simulate artificial imagination.Learning from a random player using the reference neuron model in the Proceedings of the 2002 Congress on Evolutionary Computation, 2002. https://ieeexplore.ieee.org/document/1007019/;jsessionid=BBE5A0E379BB9B061933356B7461B639?arnumber=1007019
Another important project is being led by Hiroharu Kato and Tatsuya Harada at the University of Tokyo in Japan. They have developed a computer capable of translating a description of an object into an image, which could be the easiest way to define what imagination is. Their idea is based on the concept of an image as a series of pixels divided into short sequences that correspond to a specific part of an image. The scientists call this sequences “visual words” and those can be interpreted by the machine using statistical distribution to read an create an image of an object the machine has not encountered.
The topic of artificial imagination has garnered interest from scholars outside the computer science domain, such as noted communications scholar Ernest Bormann, who came up with the Symbolic Convergence Theory and worked on a project to develop artificial imagination in computer systems.Twentieth-Century Roots of Rhetorical Studies, by Jim A. Kuypers and Andrew King, 2001. published by Praeger/Greenwood, page 225. An interdisciplinary research seminar organized by the artist Grégory Chatonsky on artificial imagination and postdigital art has taken place since 2017 at the Ecole Normale Supérieure in Paris.Postdigital Artificial Imaginationhttp://postdigital.ens.fr
Use in interactive search
The typical application of artificial imagination is for an interactive search. Interactive searching has been developed since the mid-1990s, accompanied by the World Wide Web's development and the optimization of search engines. Based on the first query and feedback from a user, the databases to be searched are reorganized to improve the searching results.
Artificial imagination allows us to synthesize images and to develop a new image, whether it is in the database, regardless its existence in the real world. For example, the computer shows results that are based on the answer from the initial query. The user selects several relevant images, and then the technology analyzes these selections and reorganizes the images' ranks to fit the query. In this process, artificial imagination is used to synthesize the selected images and to improve the searching result with additional relevant synthesized images. This technique is based on several algorithms, including the Rocchio algorithm and the evolutionary algorithm. The Rocchio algorithm,{{Cite journal|last1=Salton|first1=Gerard|last2=Buckley|first2=Chris|date=June 1, 1990|title=Improving retrieval performance by relevance feedback|journal=Journal of the American Society for Information Science|volume=41|issue=4|pages=288–297|doi=10.1002/(SICI)1097-4571(199006)41:4<288::AID-ASI8>3.0.CO;2-H|hdl=1813/6738|hdl-access=free}} locating a query point near relevant examples and far away from irrelevant examples, is simple and works well in a small system where the databases are arranged in certain ranks. The evolutionary synthesis is composed of two steps: a standard algorithm and an enhancement of the standard algorithm.{{Cite journal|date=December 2008|title=Using an artificial imagination for texture retrieval|journal=2008 19th International Conference on Pattern Recognition|citeseerx=10.1.1.330.1562}}{{Cite book|title=An Artificial Imagination for Interactive Search|publisher=Springer Berlin Heidelberg|year=2007|pages=19–28|url=http://press.liacs.nl/publications/An%20artificial%20imagination%20for%20interactive%20search.pdf}} Through feedback from the user, there would be additional images synthesized so as to be suited to what the user is looking for.
General artificial imagination
Artificial imagination has a more general definition and wide applications.{{Cite journal |last=Runco |first=Mark A. |date=2023-12-01 |title=AI can only produce artificial creativity |journal=Journal of Creativity |volume=33 |issue=3 |pages=100063 |doi=10.1016/j.yjoc.2023.100063 |issn=2713-3745|doi-access=free }} The traditional fields of artificial imagination include visual imagination and aural imagination. More generally, all the actions to form ideas, images and concepts can be linked to imagination. Thus, artificial imagination means more than only generating graphs.{{cite arXiv | eprint=2408.14837 | last1=Valevski | first1=Dani | last2=Leviathan | first2=Yaniv | last3=Arar | first3=Moab | last4=Fruchter | first4=Shlomi | title=Diffusion Models Are Real-Time Game Engines | date=2024 | class=cs.LG }} For example, moral imagination is an important research subfield of artificial imagination, although classification of artificial imagination is difficult.
Morals are an important part to human beings' logic, while artificial morals are important in artificial imagination and artificial intelligence. A common criticism of artificial intelligence is whether human beings should take responsibility for machines‘ mistakes or decisions and how to develop well-behaved machines.{{Cite journal |last=Tigard |first=Daniel W. |date=2021-06-10 |title=Artificial Moral Responsibility: How We Can and Cannot Hold Machines Responsible |url=http://dx.doi.org/10.1017/s0963180120000985 |journal=Cambridge Quarterly of Healthcare Ethics |volume=30 |issue=3 |pages=435–447 |doi=10.1017/s0963180120000985 |pmid=34109925 |issn=0963-1801|url-access=subscription }}{{Cite journal |last1=Constantinescu |first1=Mihaela |last2=Vică |first2=Constantin |last3=Uszkai |first3=Radu |last4=Voinea |first4=Cristina |date=2022-04-12 |title=Blame It on the AI? On the Moral Responsibility of Artificial Moral Advisors |url=http://dx.doi.org/10.1007/s13347-022-00529-z |journal=Philosophy & Technology |volume=35 |issue=2 |doi=10.1007/s13347-022-00529-z |issn=2210-5433|url-access=subscription }} As nobody can give a clear description of the best moral rules, it is impossible to create machines with commonly accepted moral rules.{{Cite journal |last1=Allen |first1=Colin |last2=Varner |first2=Gary |last3=Zinser |first3=Jason |date=July 2000 |title=Prolegomena to any future artificial moral agent |url=http://dx.doi.org/10.1080/09528130050111428 |journal=Journal of Experimental & Theoretical Artificial Intelligence |volume=12 |issue=3 |pages=251–261 |doi=10.1080/09528130050111428 |issn=0952-813X|url-access=subscription }} However, recent research about artificial morals circumvent the definition of moral. Instead, machine learning methods are applied to train machines to imitate human morals.{{Cite journal |last1=Moser |first1=Christine |last2=den Hond |first2=Frank |last3=Lindebaum |first3=Dirk |date=March 2022 |title=Morality in the Age of Artificially Intelligent Algorithms |url=http://dx.doi.org/10.5465/amle.2020.0287 |journal=Academy of Management Learning & Education |volume=21 |issue=1 |pages=139–155 |doi=10.5465/amle.2020.0287 |issn=1537-260X|hdl=1871.1/042dea52-f339-445e-932c-8a06c9a51c0a |hdl-access=free }}{{Cite journal |last=Floridi |first=Luciano |date=2016-12-28 |title=Faultless responsibility: on the nature and allocation of moral responsibility for distributed moral actions |url=http://dx.doi.org/10.1098/rsta.2016.0112 |journal=Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences |volume=374 |issue=2083 |pages=20160112 |doi=10.1098/rsta.2016.0112 |pmid=28336791 |bibcode=2016RSPTA.37460112F |issn=1364-503X}} As the data about moral decisions from thousands of different people are considered, the trained moral model can reflect widely accepted rules.
Memory is another major field of artificial imagination. Researchers such as Aude Oliva have performed extensive work on artificial memory, especially visual memory.{{Cite journal|title=Visual long-term memory has a massive storage capacity for object details|last=Oliva|first=Aude|doi=10.1073/pnas.0803390105|pmid=18787113|volume=105|issue=38|journal=Proceedings of the National Academy of Sciences|pages=14325–14329|year=2008|bibcode=2008PNAS..10514325B|pmc=2533687|doi-access=free}} Compared to visual imagination, the visual memory focuses more on how machine understand, analyse and store pictures in a human way. In addition, characters like spatial features are also considered. As this field is based on the brains' biological structures, extensive research on neuroscience has also been performed, which makes it a large intersection between biology and computer science.
See also
Further reading
- How to Build a Mind: Toward Machines with Imagination by Igor Aleksander