models of neural computation

Due to the complexity of nervous system behavior, the associated experimental error bounds are ill-defined, but the relative merit of the different models of a particular subsystem can be compared according to how closely they reproduce real-world behaviors or respond to specific input signals. In the closely related field of computational neuroethology, the practice is to include the environment in the model in such a way that the loop is closed. In the cases where competing models are unavailable, or where only gross responses have been measured or quantified, a clearly formulated model can guide the scientist in designing experiments to probe biochemical mechanisms or network connectivity.

In all but the simplest cases, the mathematical equations that form the basis of a model cannot be solved exactly. Nevertheless, computer technology, sometimes in the form of specialized software or hardware architectures, allow scientists to perform iterative calculations and search for plausible solutions. A computer chip or a robot that can interact with the natural environment in ways akin to the original organism is one embodiment of a useful model. The ultimate measure of success is however the ability to make testable predictions.

The rate of information processing in biological neural systems are constrained by the speed at which an action potential can propagate down a nerve fibre. This conduction velocity ranges from 1 m/s to over 100 m/s, and generally increases with the diameter of the neuronal process. Slow in the timescales of biologically-relevant events dictated by the speed of sound or the force of gravity, the nervous system overwhelmingly prefers parallel computations over serial ones in time-critical applications.

A model is robust if it continues to produce the same computational results under variations in inputs or operating parameters introduced by noise. For example, the direction of motion as computed by a robust motion detector would not change under small changes of luminance, contrast or velocity jitter. For simple mathematical models of neuron, for example the dependence of spike patterns on signal delay is much weaker than the dependence on changes in "weights" of interneuronal connections.{{cite journal |last1=Cejnar |first1=Pavel |last2=Vyšata |first2=Oldřich |last3=Vališ |first3=Martin |last4=Procházka |first4=Aleš |title=The Complex Behaviour of a Simple Neural Oscillator Model in the Human Cortex |journal=IEEE Transactions on Neural Systems and Rehabilitation Engineering |date=2019 |volume=27 |issue=3 |pages=337–347 |doi= 10.1109/TNSRE.2018.2883618 |pmid=30507514|s2cid=54527064 }}

This refers to the principle that the response of a nervous system should stay within certain bounds even as the inputs from the environment change drastically. For example, when adjusting between a sunny day and a moonless night, the retina changes the relationship between light level and neuronal output by a factor of more than $10^6$ so that the signals sent to later stages of

the visual system always remain within a much narrower range of amplitudes.{{cite news

| title = A New Mechanism for Neuronal Gain Control

|author1=Nicholas J. Priebe |author2=David Ferster

|name-list-style=amp | publisher = Neuron

| year = 2002

| volume = 35

| pages = 602–604

| issue=4}}Klein, S. A., Carney, T., Barghout-Stein, L., & Tyler, C. W. (1997, June). Seven models of masking. In Electronic Imaging'97 (pp. 13–24). International Society for Optics and Photonics.Barghout-Stein, Lauren. On differences between peripheral and foveal pattern masking. Diss. University of California, Berkeley, 1999.

A linear system is one whose response in a specified unit of measure, to a set of inputs considered at once, is the sum of its responses due to the inputs considered individually.

Linear systems are easier to analyze mathematically and are a persuasive assumption in many models including the McCulloch and Pitts neuron, population coding models, and the simple neurons often used in Artificial neural networks. Linearity may occur in the basic elements of a neural circuit such as the response of a postsynaptic neuron, or as an emergent property of a combination of nonlinear subcircuits.{{cite journal|last1=Molnar|first1=Alyosha|last2=Hsueh|first2=Hain-Ann|last3=Roska|first3=Botond|last4=Werblin|first4=Frank S.|title=Crossover inhibition in the retina: circuitry that compensates for nonlinear rectifying synaptic transmission|journal=Journal of Computational Neuroscience|volume=27|issue=3|year=2009|pages=569–590|issn=0929-5313|doi=10.1007/s10827-009-0170-6 | pmid = 19636690|pmc=2766457}} Though linearity is often seen as incorrect, there has been recent work suggesting it may, in fact, be biophysically plausible in some cases.{{Cite journal|last1=Singh|first1=Chandan|last2=Levy|first2=William B.|date=2017-07-13|title=A consensus layer V pyramidal neuron can sustain interpulse-interval coding|journal=PLOS ONE|volume=12|issue=7|pages=e0180839|doi=10.1371/journal.pone.0180839|pmid=28704450|pmc=5509228|arxiv=1609.08213|bibcode=2017PLoSO..1280839S|issn=1932-6203|doi-access=free}}{{Cite journal|last1=Cash|first1=Sydney|last2=Yuste|first2=Rafael|date=1998-01-01|title=Input Summation by Cultured Pyramidal Neurons Is Linear and Position-Independent|journal=Journal of Neuroscience|language=en|volume=18|issue=1|pages=10–15|issn=0270-6474|pmid=9412481|doi=10.1523/JNEUROSCI.18-01-00010.1998|pmc=6793421|doi-access=free}}

A computational neural model may be constrained to the level of biochemical signalling in individual neurons or it may describe an entire organism in its environment. The examples here are grouped according to their scope.

{{main|biological neuron model}}

The most widely used models of information transfer in biological neurons are based on analogies with electrical circuits. The equations to be solved are time-dependent differential equations with electro-dynamical variables such as current, conductance or resistance, capacitance and voltage.

{{main|Hodgkin–Huxley model}}

The Hodgkin–Huxley model, widely regarded as one of the great achievements of 20th-century biophysics, describes how action potentials in neurons are initiated and propagated in axons via voltage-gated ion channels. It is a set of nonlinear ordinary differential equations that were introduced by Alan Lloyd Hodgkin and Andrew Huxley in 1952 to explain the results of voltage clamp experiments on the squid giant axon. Analytic solutions do not exist, but the Levenberg–Marquardt algorithm, a modified Gauss–Newton algorithm, is often used to fit these equations to voltage-clamp data.

The FitzHugh–Nagumo model is a simplication of the Hodgkin–Huxley model. The Hindmarsh–Rose model is an extension which describes neuronal spike bursts. The Morris–Lecar model is a modification which does not generate spikes, but describes slow-wave propagation, which is implicated in the inhibitory synaptic mechanisms of central pattern generators.

{{main|Soliton model in neuroscience}}

The soliton model is an alternative to the Hodgkin–Huxley model that claims to explain how action potentials are initiated and conducted in the form of certain kinds of solitary sound (or density) pulses that can be modeled as solitons along axons, based on a thermodynamic theory of nerve pulse propagation.

This approach, influenced by control theory and signal processing, treats neurons and synapses as time-invariant entities that produce outputs that are linear combinations of input signals, often depicted as sine waves with a well-defined temporal or spatial frequencies.

The entire behavior of a neuron or synapse are encoded in a transfer function, lack of knowledge concerning the exact underlying mechanism notwithstanding. This brings a highly developed mathematics to bear on the problem of information transfer.

The accompanying taxonomy of linear filters turns out to be useful in characterizing neural circuitry. Both low- and high-pass filters are postulated to exist in some form in sensory systems, as they act to prevent information loss in high and low contrast environments, respectively.

Indeed, measurements of the transfer functions of neurons in the horseshoe crab retina according to linear systems analysis show that they remove short-term fluctuations in input signals leaving only the long-term trends, in the manner of low-pass filters. These animals are unable to see low-contrast objects without the help of optical distortions caused by underwater currents.{{cite journal

| title = The Neural Network of the Limulus Retina: From Computer to Behavior

|author1=Robert B. Barlow, Jr. |author2=Ramkrishna Prakash |author3=Eduardo Solessio | journal = American Zoologist

| year = 1993

| volume = 33

| pages = 66–78

| doi=10.1093/icb/33.1.66

| doi-access = free

}}{{cite journal

| doi = 10.2307/1543311

| title = Limulus Vision in the Marine Environment

| author = Robert B. Barlow, James M. Hitt and Frederick A. Dodge

| journal = The Biological Bulletin

| year = 2001

| volume = 200

| issue = 2

| pages = 169–176

| pmid = 11341579

| jstor = 1543311

| citeseerx = 10.1.1.116.5190

| s2cid = 18371282

}}

In the retina, an excited neural receptor can suppress the activity of surrounding neurons within an area called the inhibitory field. This effect, known as lateral inhibition, increases the contrast and sharpness in visual response, but leads to the epiphenomenon of Mach bands. This is often illustrated by the optical illusion of light or dark stripes next to a sharp boundary between two regions in an image of different luminance.

The Hartline-Ratliff model describes interactions within a group of p photoreceptor cells.{{cite journal

| doi = 10.1007/BF00319520

| title = Stationary States of the Hartline–Ratliff Model

|author1=K. P. Hadeler |author2=D. Kuhn

|name-list-style=amp | journal = Biological Cybernetics

| year = 1987

| volume = 56

| pages = 411–417

| issue = 5–6

| s2cid = 8710876

}} Assuming these interactions to be linear, they proposed the following relationship for the steady-state response rate $r\_p$ of the given p-th photoreceptor in terms of the steady-state response rates $r\_j$ of the j surrounding receptors:

$r\_\{p\}=\backslash left|\backslash left[e\_\{p\}-\backslash sum\_\{j=1,j\backslash ne\; p\}^\{n\}k\_\{pj\}\backslash left|r\_\{j\}-r\_\{pj\}^\{o\}\backslash right|\backslash right]\backslash right|$.

Here,

$e\_p$ is the excitation of the target p-th receptor from sensory transduction

$r\_\{pj\}^o$ is the associated threshold of the firing cell, and

$k\_\{pj\}$ is the coefficient of inhibitory interaction between the p-th and the jth receptor. The inhibitory interaction decreases with distance from the target p-th receptor.

According to Jeffress,{{cite journal | last1 = Jeffress | first1 = L.A. | year = 1948 | title = A place theory of sound localization | journal = Journal of Comparative and Physiological Psychology | volume = 41 | issue = 1| pages = 35–39 | doi=10.1037/h0061495 | pmid=18904764}} in order to compute the location of a sound source in space from interaural time differences, an auditory system relies on delay lines: the induced signal from an ipsilateral auditory receptor to a particular neuron is delayed for the same time as it takes for the original sound to go in space from that ear to the other. Each postsynaptic cell is differently delayed and thus specific for a particular inter-aural time difference. This theory is equivalent to the mathematical procedure of cross-correlation.

Following Fischer and Anderson,{{cite journal | last1 = Fischer | first1 = Brian J. | last2 = Anderson | first2 = Charles H. | year = 2004 | title = A computational model of sound localization in the barn owl | journal = Neurocomputing | volume = 58–60 | pages = 1007–1012 | doi=10.1016/j.neucom.2004.01.159| s2cid = 31927198 }} the response of the postsynaptic neuron to the signals from the left and right ears is given by

$y\_\{R\}\backslash left(t\backslash right)\; -\; y\_\{L\}\backslash left(t\backslash right)$

where

$y\_\{L\}\backslash left(t\backslash right)=\backslash int\_\{0\}^\{\backslash tau\}u\_\{L\}\backslash left(\backslash sigma\backslash right)w\backslash left(t-\backslash sigma\backslash right)d\backslash sigma$

$y\_\{R\}\backslash left(t\backslash right)=\backslash int\_\{0\}^\{\backslash tau\}u\_\{R\}\backslash left(\backslash sigma\backslash right)w\backslash left(t-\backslash sigma\backslash right)d\backslash sigma$

and

$w\backslash left(t-\backslash sigma\backslash right)$ represents the delay function. This is not entirely correct and a clear eye is needed to put the symbols in order.

Structures have been located in the barn owl which are consistent with Jeffress-type mechanisms.Catherine E. Carr, 1993. Delay Line Models of Sound Localization in the Barn Owl "American Zoologist" Vol. 33, No. 1 79–85

A motion detector needs to satisfy three general requirements: pair-inputs, asymmetry and nonlinearity.Borst A, Egelhaaf M., 1989. Principles of visual motion detection. "Trends in Neurosciences" 12(8):297–306 The cross-correlation operation implemented asymmetrically on the responses from a pair of photoreceptors satisfies these minimal criteria, and furthermore, predicts features which have been observed in the response of neurons of the lobula plate in bi-wing insects.{{cite journal | last1 = Joesch | first1 = M. |display-authors=etal | year = 2008 | title = Response properties of motion-sensitive visual interneurons in the lobula plate of Drosophila melanogaster | journal = Curr. Biol. | volume = 18 | issue = 5| pages = 368–374 | doi=10.1016/j.cub.2008.02.022| pmid = 18328703 | s2cid = 18873331 | doi-access = free | bibcode = 2008CBio...18..368J }}

The master equation for response is

$R\; =\; A\_1(t-\backslash tau)B\_2(t)\; -\; A\_2(t\; -\; \backslash tau)B\_1(t)$

The HR model predicts a peaking of the response at a particular input temporal frequency. The conceptually similar Barlow–Levick model is deficient in the sense that a stimulus presented to only one receptor of the pair is sufficient to generate a response. This is unlike the HR model, which requires two correlated signals delivered in a time ordered fashion. However the HR model does not show a saturation of response at high contrasts, which is observed in experiment. Extensions of the Barlow-Levick model can provide for this discrepancy.Gonzalo G. de Polavieja, 2006. Neuronal Algorithms That Detect the Temporal Order of Events "Neural Computation" 18 (2006) 2102–2121

This uses a cross-correlation in both the spatial and temporal directions, and is related to the concept of optical flow.Andrew B. Watson and Albert J. Ahumada, Jr., 1985. Model of human visual-motion sensing "J. Opt. Soc. Am. A" 2(2) 322–341

• {{cite journal | last1 = Tzounopoulos | first1 = T | last2 = Kim | first2 = Y | last3 = Oertel | first3 = D | last4 = Trussell | first4 = LO | year = 2004 | title = Cell-specific, spike timing-dependent plasticities in the dorsal cochlear nucleus | journal = Nat Neurosci | volume = 7 | issue = 7| pages = 719–725 | doi=10.1038/nn1272| pmid = 15208632 | s2cid = 17774457 }}
• {{cite journal | last1 = Roberts | first1 = Patrick D. | last2 = Portfors | first2 = Christine V. | year = 2008 | title = Design principles of sensory processing in cerebellum-like structures| doi = 10.1007/s00422-008-0217-1 | pmid = 18491162 | journal = Biological Cybernetics | volume = 98 | issue = 6| pages = 491–507 | s2cid = 14393814 }}

Mutually inhibitory processes are a unifying motif of all central pattern generators. This has been demonstrated in the stomatogastric (STG) nervous system of crayfish and lobsters.Michael P. Nusbaum and Mark P. Beenhakker, A small-systems approach to motor pattern generation, Nature 417, 343–350 (16 May 2002) Two and three-cell oscillating networks based on the STG have been constructed which are amenable to mathematical analysis, and which depend in a simple way on synaptic strengths and overall activity, presumably the knobs on these things.Cristina Soto-Treviño, Kurt A. Thoroughman and Eve Marder, L. F. Abbott, 2006. Activity-dependent modification of inhibitory synapses in models of rhythmic neural networks Nature Vol 4 No 3 2102–2121 The mathematics involved is the theory of dynamical systems.

Flight control in the fly is believed to be mediated by inputs from the visual system and also the halteres, a pair of knob-like organs which measure angular velocity. Integrated computer models of Drosophila, short on neuronal circuitry but based on the general guidelines given by control theory and data from the tethered flights of flies, have been constructed to investigate the details of flight control.{{cite web|url=http://strawlab.org/2011/03/23/grand-unified-fly/|title=the Grand Unified Fly (GUF) model}}http://www.mendeley.com/download/public/2464051/3652638122/d3bd7957efd2c8a011afb0687dfb6943731cb6d0/dl.pdf{{Dead link|date=April 2020 |bot=InternetArchiveBot |fix-attempted=yes }}

Tensor network theory is a theory of cerebellar function that provides a mathematical model of the transformation of sensory space-time coordinates into motor coordinates and vice versa by cerebellar neuronal networks. The theory was developed by Andras Pellionisz and Rodolfo Llinas in the 1980s as a geometrization of brain function (especially of the central nervous system) using tensors.{{Cite journal| author =Pellionisz, A., Llinás, R. | year =1980 | title =Tensorial Approach to the Geometry of Brain Function: Cerebellar Coordination Via A Metric Tensor | journal = Neuroscience | volume =5 | issue = 7| pages = 1125––1136 | url= https://www.academia.edu/download/31409354/pellionisz_1980_cerebellar_coordination_via_a_metric_tensor_fullpaper.pdf | doi = 10.1016/0306-4522(80)90191-8 | pmid=6967569| s2cid =17303132 }}{{dead link|date=July 2022|bot=medic}}{{cbignore|bot=medic}}{{Cite journal| author = Pellionisz, A., Llinás, R. | year =1985 | title= Tensor Network Theory of the Metaorganization of Functional Geometries in the Central Nervous System | journal = Neuroscience | volume =16 | issue =2 | pages = 245–273| doi = 10.1016/0306-4522(85)90001-6 | pmid = 4080158| s2cid =10747593 }}

{{main|neural network}}

In this approach the strength and type, excitatory or inhibitory, of synaptic connections are represented by the magnitude and sign of weights, that is, numerical coefficients $w\text{'}$ in front of the inputs $x$ to a particular neuron. The response of the $j$-th neuron is given by a sum of nonlinear, usually "sigmoidal" functions $g$ of the inputs as:

$f\_\{j\}=\backslash sum\_\{i\}g\backslash left(w\_\{ji\}\text{'}x\_\{i\}+b\_\{j\}\backslash right)$.

This response is then fed as input into other neurons and so on. The goal is to optimize the weights of the neurons to output a desired response at the output layer respective to a set given inputs at the input layer. This optimization of the neuron weights is often performed using the backpropagation algorithm and an optimization method such as gradient descent or Newton's method of optimization. Backpropagation compares the output of the network with the expected output from the training data, then updates the weights of each neuron to minimize the contribution of that individual neuron to the total error of the network.

Genetic algorithms are used to evolve neural (and sometimes body) properties in a model brain-body-environment system so as to exhibit some desired behavioral performance. The evolved agents can then be subjected to a detailed analysis to uncover their principles of operation. Evolutionary approaches are particularly useful for exploring spaces of possible solutions to a given behavioral task because these approaches minimize a priori assumptions about how a given behavior ought to be instantiated. They can also be useful for exploring different ways to complete a computational neuroethology model when only partial neural circuitry is available for a biological system of interest.{{cite journal|title=Computational neuroethology|first1=Randall|last1=Beer|first2=Hillel|last2=Chiel|date=4 March 2008|volume=3|issue=3|doi=10.4249/scholarpedia.5307|journal=Scholarpedia|pages=5307|bibcode=2008SchpJ...3.5307B|doi-access=free}}

The NEURON software, developed at Duke University, is a simulation environment for modeling individual neurons and networks of neurons.{{cite web|url=http://www.neuron.yale.edu/neuron/|title=NEURON - for empirically-based simulations of neurons and networks of neurons}} The NEURON environment is a self-contained environment allowing interface through its GUI or via scripting with hoc or python. The NEURON simulation engine is based on a Hodgkin–Huxley type model using a Borg–Graham formulation. Several examples of models written in NEURON are available from the online database ModelDB.McDougal RA, Morse TM, Carnevale T, Marenco L, Wang R, Migliore M, Miller PL, Shepherd GM, Hines ML.

Twenty years of ModelDB and beyond: building essential modeling tools for the future of neuroscience. J Comput Neurosci. 2017; 42(1):1–10.

Nervous systems differ from the majority of silicon-based computing devices in that they resemble analog computers (not digital data processors) and massively parallel processors, not sequential processors. To model nervous systems accurately, in real-time, alternative hardware is required.

The most realistic circuits to date make use of analog properties of existing digital electronics (operated under non-standard conditions) to realize Hodgkin–Huxley-type models in silico.L. Alvadoa, J. Tomasa, S. Saghia, S. Renauda, T. Balb, A. Destexheb, G. Le Masson, 2004. Hardware computation of conductance-based neuron models. Neurocomputing 58–60 (2004) 109–115{{cite journal|title=Silicon neurons|first1=Giacomo|last1=Indiveri|first2=Rodney|last2=Douglas|first3=Leslie|last3=Smith|date=29 March 2008|volume=3|issue=3|doi=10.4249/scholarpedia.1887|journal=Scholarpedia|pages=1887|bibcode=2008SchpJ...3.1887I|doi-access=free}}

Kwabena Boahen, "A Retinomorphic Chip with Parallel Pathways: Encoding INCREASING, ON, DECREASING, and OFF Visual Signals", Analog Integrated Circuits and Signal Processing, 30, 121–135, 2002

{{div col|colwidth=22em}}

• Cognitive architecture
• Cognitive map
• Computational neuroscience
• Motion perception
• Neural coding
• Neural correlate
• Neural decoding
• Neuroethology
• Neuroinformatics
• Quantitative models of the action potential
• Spiking neural network
• Systems neuroscience

{{div col end}}

{{Reflist}}

• [http://www.proberts.net/research/ Neural Dynamics at NSI] – Web page of Patrick D Roberts at the Neurological Sciences Institute
• [http://www.dickinson.caltech.edu/ Dickinson Lab] – Web page of the Dickinson group at Caltech which studies flight control in Drosophila

{{Neuroethology}}

{{animal cognition}}

{{DEFAULTSORT:Models Of Neural Computation}}

Category:Ethology

Category:Computational neuroscience

Category:Neuroethology