Self-organization in cybernetics
{{Short description|Patterns in cybernetics}}
{{Use American English|date = February 2019}}
Self-organization, a process where some form of overall order arises out of the local interactions between parts of an initially disordered system, was discovered in cybernetics by William Ross Ashby in 1947.{{Cite journal | doi=10.1080/00221309.1947.9918144| pmid=20270223| title=Principles of the Self-Organizing Dynamic System| journal=The Journal of General Psychology| volume=37| issue=2| pages=125–8| year=1947| last1=Ashby | first1=W. R.}}Ashby, W. R. (1962). [http://csis.pace.edu/~marchese/CS396x/Computing/Ashby.pdf "Principles of the self-organizing system"], pp. 255–278 in Principles of Self-Organization. Heinz von Foerster and George W. Zopf, Jr. (eds.) U.S. Office of Naval Research. It states that any deterministic dynamic system automatically evolves towards a state of equilibrium that can be described in terms of an attractor in a basin of surrounding states. Once there, the further evolution of the system is constrained to remain in the attractor. This constraint implies a form of mutual dependency or coordination between its constituent components or subsystems. In Ashby's terms, each subsystem has adapted to the environment formed by all other subsystems.
The cybernetician Heinz von Foerster formulated the principle of "order from noise" in 1960.Von Foerster, H. (1960). [http://e1020.pbworks.com/f/fulltext.pdf "On self-organizing systems and their environments"], pp. 31–50 in Self-organizing systems. M.C. Yovits and S. Cameron (eds.), Pergamon Press, London Asaro, P. (2007). [https://peterasaro.org/writing/Asaro%20HVF%26BCL.pdf "Heinz von Foerster and the Bio-Computing Movements of the 1960s"] in Albert Müller and Karl H. Müller (eds.) An Unfinished Revolution? Heinz von Foerster and the Biological Computer Laboratory BCL 1958–1976. Vienna, Austria: Edition Echoraum. It notes that self-organization is facilitated by random perturbations ("noise") that let the system explore a variety of states in its state space. This increases the chance that the system will arrive into the basin of a "strong" or "deep" attractor, from which it then quickly enters the attractor itself. The biophysicist Henri Atlan developed such a concept by proposing the principle of "complexity from noise"See [https://www.google.com/search?&tbm=bks&q=inauthor:%22Henri+Atlan%22%22complexity+from+noise%22 occurrences] on Google Books.{{cite book |editor-last=François |editor-first=Charles |editor-link=Charles François (systems scientist) |title=International Encyclopedia of Systems and Cybernetics |year=2011 |orig-date=1997 |edition=2nd |publisher=Walter de Gruyter |location=Berlin |page=[https://books.google.com/books?id=XCn2mn98uEAC&dq=%22complexity+from+noise+principle%22+Atlan+1972&pg=PA107 107] |isbn=978-3-1109-6801-9 |title-link=International Encyclopedia of Systems and Cybernetics }} ({{langx|fr|le principe de complexité par le bruit}})See [https://www.google.com/search?&tbm=bks&q=inauthor:%22Henri+Atlan%22%22complexité+par+le+bruit%22 occurrences] on Google Books. first in the 1972 book L'organisation biologique et la théorie de l'information{{Cite web|url=https://www.google.com/search?&q=%22complexit%C3%A9+par+le+bruit%22%22L%27Organisation+biologique+et+la+th%C3%A9orie+de+l%27information%22+1972|title="complexité par le bruit""L'Organisation biologique et la théorie de l'information" 1972 - Google Search|website=www.google.com}} and then in the 1979 book Entre le cristal et la fumée.{{Cite web|url=https://www.google.com/search?&q=%22complexit%C3%A9+par+le+bruit%22%22Entre+le+cristal+et+la+fum%C3%A9e%22+1979|title="complexité par le bruit""Entre le cristal et la fumée" 1979 - Google Search|website=www.google.com}} The thermodynamicist Ilya Prigogine formulated a similar principle as "order through fluctuations"Nicolis, G. and Prigogine, I. (1977). Self-organization in nonequilibrium systems: From dissipative structures to order through fluctuations. Wiley, New York. or "order out of chaos".Prigogine, I. and Stengers, I. (1984). Order out of chaos: Man's new dialogue with nature. Bantam Books. It is applied in the method of simulated annealing for problem solving and machine learning.{{cite journal|last1=Ahmed|first1=Furqan|last2=Tirkkonen |first2=Olav|title=Simulated annealing variants for self-organized resource allocation in small cell networks|journal=Applied Soft Computing|date=January 2016 |volume=38|pages=762–770 |doi=10.1016/j.asoc.2015.10.028 |s2cid=10126852 }}
Wiener regarded the automatic serial identification of a black box and its subsequent reproduction (copying) as sufficient to meet the condition of self-organization.Wiener, Norbert (1962) "The mathematics of self-organising systems". Recent developments in information and decision processes, Macmillan, N. Y. and Chapter X in Cybernetics, or control and communication in the animal and the machine, The MIT Press. The importance of phase locking or the "attraction of frequencies", as he called it, is discussed in the 2nd edition of his "Cybernetics".Cybernetics, or control and communication in the animal and the machine, The MIT Press, Cambridge, Massachusetts and Wiley, NY, 1948. 2nd Edition 1962 "Chapter X "Brain Waves and Self-Organizing Systems"pp 201–202. Drexler sees self-replication (copying) as a key step in nano and universal assembly.Eric K. Drexler "Engines of Creation" 1986 In later work he seeks to lessen this constraint.{{Cite web | title=Engines of Creation 2 | url=http://www1.appstate.edu/dept/physics/nanotech/EnginesofCreation2_8803267.pdf | archive-url=https://web.archive.org/web/20140810022659/http://www1.appstate.edu/dept/physics/nanotech/EnginesofCreation2_8803267.pdf | archive-date=2014-08-10}}
By contrast, the four concurrently connected galvanometers of W. Ross Ashby's Homeostat hunt, when perturbed, to converge on one of many possible stable states.Ashby, William Ross (1952) Design for a Brain, Chapter 5 Chapman & Hall Ashby used his state counting measure of varietyAshby, William Ross (1956) [http://pespmc1.vub.ac.be/books/introcyb.pdf An Introduction to Cybernetics], Part Two Chapman & Hall to describe stable states and produced the "Good Regulator"{{cite journal |last1=Conant |first1=Roger C. |last2=Ross Ashby |first2=W. |title=Every good regulator of a system must be a model of that system |journal=International Journal of Systems Science |date=8 March 2007 |volume=1 |issue=2 |pages=89–97 |doi=10.1080/00207727008920220 }} theorem which requires internal models for self-organized endurance and stability (e.g. Nyquist stability criterion).
Warren McCulloch proposed "Redundancy of Potential Command"Embodiments of Mind MIT Press (1965)" as characteristic of the organization of the brain and human nervous system and the necessary condition for self-organization.
Heinz von Foerster proposed Redundancy, R = 1 − H/Hmax, where H is entropy.{{cite journal|author=von Foerster, Heinz |author2= Pask, Gordon |title=A Predictive Model for Self-Organizing Systems, Part I|journal=Cybernetica|volume= 3|pages= 258–300|year=1961}}{{cite journal|author=von Foerster, Heinz |author2= Pask, Gordon |title=A Predictive Model for Self-Organizing Systems, Part II|journal=Cybernetica|volume= 4 |pages=20–55|year= 1961}} In essence this states that unused potential communication bandwidth is a measure of self-organization.
In the 1970s Stafford Beer considered this condition as necessary for autonomy which identifies self-organization in persisting and living systems. He applied his viable system model to management. It consists of five parts: the monitoring of performance of the survival processes (1), their management by recursive application of regulation (2), homeostatic operational control (3) and development (4) which produce maintenance of identity (5) under environmental perturbation. Focus is prioritized by an alerting "algedonic loop" feedback: a sensitivity to both pain and pleasure produced from under-performance or over-performance relative to a standard capability."Brain of the Firm" Alan Lane (1972) see also "Beyond Dispute," Wiley, Stafford Beer 1994 "Redundancy of Potential Command" pp. 157–158.{{Full citation needed|date=April 2018}}
In the 1990s Gordon Pask pointed out von Foerster's H and Hmax were not independent and interacted via countably infinite recursive concurrent spin processes (he favoured the Bohm interpretation) which he called concepts (liberally defined in any medium, "productive and, incidentally reproductive"). His strict definition of concept "a procedure to bring about a relation"Pask, G. (1973). Conversation, Cognition and Learning. A Cybernetic Theory and Methodology. Elsevier permitted his theorem "Like concepts repel, unlike concepts attract"{{cite journal |last1=Green |first1=Nick |title=On Gordon Pask |journal=Kybernetes |date=July 2001 |volume=30 |issue=5/6 |pages=673–682 |doi=10.1108/03684920110391913 }} to state a general spin based principle of self-organization. His edict, an exclusion principle, "There are No Doppelgangers"Pask, Gordon (1993) [http://www.cybsoc.org/PasksIAT.PDF Interactions of Actors (IA), Theory and Some Applications].{{cite journal |last1=Pask |first1=Gordon |title=Heinz von Foerster's Self Organization, the Progenitor of Conversation and Interaction Theories |journal=Systems Research |date=September 1996 |volume=13 |issue=3 |pages=349–362 |doi=10.1002/(sici)1099-1735(199609)13:3<349::aid-sres103>3.3.co;2-7 }} means no two concepts can be the same (all interactions occur with different perspectives making time incommensurable for actors). This means, after sufficient duration as differences assert, all concepts will attract and coalesce as pink noise and entropy increases (and see Big Crunch, self-organized criticality). The theory is applicable to all organizationally closed or homeostatic processes that produce enduring and coherent products (where spins have a fixed average phase relationship and also in the sense of Nicholas Rescher's coherence theory of truth with the proviso that the sets and their members exert repulsive forces at their boundaries) through interactions: evolving, learning and adapting.
Pask's Interactions of Actors "hard carapace" model is reflected in some of the ideas of emergence and coherence. It requires a knot emergence topology that produces radiation during interaction with a unit cell that has a prismatic tensegrity structure. Laughlin's contribution to emergence reflects some of these constraints.{{cite journal |last1=Laughlin |first1=R. B. |last2=Pines |first2=David |title=The Theory of Everything |journal=Proceedings of the National Academy of Sciences of the United States of America |date=4 January 2000 |volume=97 |issue=1 |pages=28–31 |doi=10.1073/pnas.97.1.28 |pmid=10618365 |pmc=26610 |doi-access=free }}