Faà di Bruno's formula

Faà di Bruno's formula is an identity in mathematics generalizing the chain rule to higher derivatives. It is named after {{harvs|txt|authorlink=Francesco Faà di Bruno|first=Francesco|last= Faà di Bruno|year=1855|year2=1857}}, although he was not the first to state or prove the formula. In 1800, more than 50 years before Faà di Bruno, the French mathematician Louis François Antoine Arbogast had stated the formula in a calculus textbook,{{harv|Arbogast|1800}}. which is considered to be the first published reference on the subject.According to {{harvtxt|Craik|2005|pp=120–122}}: see also the analysis of Arbogast's work by {{harvtxt|Johnson|2002|p=230}}.

Perhaps the most well-known form of Faà di Bruno's formula says that

${d^n \over dx^n} f(g(x))=\sum \frac{n!}{m_1!\,1!^{m_1}\,m_2!\,2!^{m_2}\,\cdots\,m_n!\,n!^{m_n}}\cdot f^{(m_1+\cdots+m_n)}(g(x))\cdot \prod_{j=1}^n\left(g^{(j)}(x)\right)^{m_j},$

where the sum is over all $n$ -tuples of nonnegative integers $(m_1,\ldots,m_n)$ satisfying the constraint

$1\cdot m_1+2\cdot m_2+3\cdot m_3+\cdots+n\cdot m_n=n.$

Sometimes, to give it a memorable pattern, it is written in a way in which the coefficients that have the combinatorial interpretation discussed below are less explicit:

: ${d^n \over dx^n} f(g(x))
=\sum \frac{n!}{m_1!\,m_2!\,\cdots\,m_n!}\cdot
f^{(m_1+\cdots+m_n)}(g(x))\cdot
\prod_{j=1}^n\left(\frac{g^{(j)}(x)}{j!}\right)^{m_j}.$

Combining the terms with the same value of $m_1+m_2+\cdots+m_n=k$

and noticing that $m_j$ has to be zero for $j>n-k+1$ leads to a somewhat simpler formula expressed in terms of partial (or incomplete) exponential Bell polynomials

$B_{n,k}(x_1,\ldots,x_{n-k+1})$ :

: ${d^n \over dx^n} f(g(x)) = \sum_{k=0}^n f^{(k)}(g(x))\cdot B_{n,k}\left(g'(x),g''(x),\dots,g^{(n-k+1)}(x)\right).$

This formula works for all $n \geq 0$ , however for $n>0$ the polynomials $B_{n,0}$ are zero and thus summation in the formula can start with $k=1$ .

Combinatorial form

The formula has a "combinatorial" form:

: ${d^n \over dx^n} f(g(x))=(f\circ g)^{(n)}(x)=\sum_{\pi\in\Pi} f^{(\left|\pi\right|)}(g(x))\cdot\prod_{B\in\pi}g^{(\left|B\right|)}(x)$

where

$\pi$ runs through the set $\Pi$ of all partitions of the set $\{1,\ldots,n\}$ ,
" $B\in\pi$ " means the variable $B$ runs through the list of all of the "blocks" of the partition $\pi$ , and
$|A|$ denotes the cardinality of the set $A$ (so that $|\pi|$ is the number of blocks in the partition $\pi$ and $|B|$ is the size of the block $B$ ).

Example

The following is a concrete explanation of the combinatorial form for the $n=4$ case.

: $\begin{align}
(f\circ g)$ (x) = {} & f(g(x))g'(x)^4 + 6f'(g(x))g(x)g'(x)^2 \\[8pt] & {} +\; 3f(g(x))g(x)^2 + 4f(g(x))g'(x)g'(x) \\[8pt] & {} +\; f'(g(x))g(x). \end{align}

The pattern is:

: $\begin{array}{cccccc}
g'(x)^4
& & \leftrightarrow & & 1+1+1+1
& & \leftrightarrow & & f$ (g(x)) & & \leftrightarrow & & 1 \\[12pt] g''(x)g'(x)^2 & & \leftrightarrow & & 2+1+1 & & \leftrightarrow & & f'''(g(x)) & & \leftrightarrow & & 6 \\[12pt] g''(x)^2 & & \leftrightarrow & & 2+2 & & \leftrightarrow & & f''(g(x)) & & \leftrightarrow & & 3 \\[12pt] g'''(x)g'(x) & & \leftrightarrow & & 3+1 & & \leftrightarrow & & f''(g(x)) & & \leftrightarrow & & 4 \\[12pt] g(x) & & \leftrightarrow & & 4 & & \leftrightarrow & & f'(g(x)) & & \leftrightarrow & & 1 \end{array}

The factor $g$ (x)g'(x)^2 corresponds to the partition 2 + 1 + 1 of the integer 4, in the obvious way. The factor $f$ '(g(x)) that goes with it corresponds to the fact that there are three summands in that partition. The coefficient 6 that goes with those factors corresponds to the fact that there are exactly six partitions of a set of four members that break it into one part of size 2 and two parts of size 1.

Similarly, the factor $g$ (x)^2 in the third line corresponds to the partition 2 + 2 of the integer 4, (4, because we are finding the fourth derivative), while $f$ (g(x)) corresponds to the fact that there are two summands (2 + 2) in that partition. The coefficient 3 corresponds to the fact that there are $\tfrac{1}{2}\tbinom{4}{2}=3$ ways of partitioning 4 objects into groups of 2. The same concept applies to the others.

A memorizable scheme is as follows:

: $\begin{align} & \frac{D^1(f\circ{}g)}{1!} & = \left(f^{(1)}\circ{}g\right)\frac{\frac{g^{(1)} }{1!} }{1!} \\[8pt]
& \frac{D^2(f\circ g)}{2!} & = \left(f^{(1)}\circ{}g\right)\frac{\frac{g^{(2)} }{2!} }{1!} & {} + \left(f^{(2)}\circ{}g\right)\frac{\frac{g^{(1)} }{1!}\frac{g^{(1)} }{1!} }{2!} \\[8pt]
& \frac{D^3(f\circ g)}{3!} & = \left(f^{(1)}\circ{}g\right)\frac{\frac{g^{(3)} }{3!} }{1!} & {} + \left(f^{(2)}\circ{}g\right)\frac{\frac{g^{(1)} }{1!} }{1!}\frac{\frac{g^{(2)} }{2!} }{1!} & {} + \left(f^{(3)}\circ{}g\right)\frac{\frac{g^{(1)} }{1!}\frac{g^{(1)} }{1!}\frac{g^{(1)} }{1!} }{3!} \\[8pt]
& \frac{D^4(f\circ g)}{4!} & = \left(f^{(1)}\circ{}g\right)\frac{\frac{g^{(4)} }{4!} }{1!} & {} + \left(f^{(2)}\circ{}g\right)\left(\frac{\frac{g^{(1)} }{1!} }{1!}\frac{\frac{g^{(3)} }{3!} }{1!}+\frac{\frac{g^{(2)} }{2!}\frac{g^{(2)} }{2!} }{2!}\right) & {} + \left(f^{(3)}\circ{}g\right)\frac{\frac{g^{(1)} }{1!}\frac{g^{(1)} }{1!} }{2!}\frac{\frac{g^{(2)} }{2!} }{1!} & {} + \left(f^{(4)}\circ{}g\right)\frac{\frac{g^{(1)} }{1!}\frac{g^{(1)} }{1!}\frac{g^{(1)} }{1!}\frac{g^{(1)} }{1!} }{4!}
\end{align}$

Variations

=Multivariate version=

Let $y=g(x_1,\dots,x_n)$ . Then the following identity holds regardless of whether the $n$ variables are all distinct, or all identical, or partitioned into several distinguishable classes of indistinguishable variables (if it seems opaque, see the very concrete example below):{{cite journal |last=Hardy |first=Michael |title=Combinatorics of Partial Derivatives |journal=Electronic Journal of Combinatorics |volume=13 |issue=1 |year=2006 |pages=R1 |doi=10.37236/1027 |s2cid=478066 |url=http://www.combinatorics.org/Volume_13/Abstracts/v13i1r1.html|doi-access=free }}

: ${\partial^n \over \partial x_1 \cdots \partial x_n}f(y)
= \sum_{\pi\in\Pi} f^{(\left|\pi\right|)}(y)\cdot\prod_{B\in\pi}
{\partial^{\left|B\right|}y \over \prod_{j\in B} \partial x_j}$

where (as above)

$\pi$ runs through the set $\Pi$ of all partitions of the set $\{1,\ldots,n\}$ ,
" $B\in\pi$ " means the variable $B$ runs through the list of all of the "blocks" of the partition $\pi$ , and
$|A|$ denotes the cardinality of the set $A$ (so that $|\pi|$ is the number of blocks in the partition $\pi$ and

$|B|$ is the size of the block $B$ ).

More general versions hold for cases where the all functions are vector- and even Banach-space-valued. In this case one needs to consider the Fréchet derivative or Gateaux derivative.

; Example

The five terms in the following expression correspond in the obvious way to the five partitions of the set $\{1,2,3\}$ , and in each case the order of the derivative of $f$ is the number of parts in the partition:

: $\begin{align}
{\partial^3 \over \partial x_1\, \partial x_2\, \partial x_3}f(y)
= {} & f'(y){\partial^3 y \over \partial x_1\, \partial x_2\, \partial x_3} \\[10pt]
& {} + f''(y) \left( {\partial y \over \partial x_1}
\cdot{\partial^2 y \over \partial x_2\, \partial x_3}
+{\partial y \over \partial x_2}
\cdot{\partial^2 y \over \partial x_1\, \partial x_3}
+ {\partial y \over \partial x_3}
\cdot{\partial^2 y \over \partial x_1\, \partial x_2}\right) \\[10pt]
& {} + f'''(y) {\partial y \over \partial x_1}
\cdot{\partial y \over \partial x_2}
\cdot{\partial y \over \partial x_3}.
\end{align}$

If the three variables are indistinguishable from each other, then three of the five terms above are also indistinguishable from each other, and then we have the classic one-variable formula.

===Formal power series version===

Suppose $f(x)=\sum_{n=0}^\infty {a_n} x^n$ and $g(x)=\sum_{n=0}^\infty {b_n} x^n$ are formal power series and $b_0 = 0$ .

Then the composition $f \circ g$ is again a formal power series,

: $f(g(x))=\sum_{n=0}^\infty{c_n}x^n,$

where $c_0=a_0$ and the other coefficient $c_n$ for $n\geq 1$

can be expressed as a sum over compositions of $n$ or as an equivalent sum over integer partitions of $n$ :

: $c_{n} = \sum_{\mathbf{i}\in \mathcal{C}_{n}} a_{k} b_{i_{1}} b_{i_{2}} \cdots b_{i_{k}},$

where

: $\mathcal{C}_{n}=\{(i_1,i_2,\dots,i_k)\,:\ 1 \le k \le n,\ i_1+i_2+ \cdots + i_k=n\}$

is the set of compositions of $n$ with $k$ denoting the number of parts,

: $c_{n} = \sum_{k=1}^{n} a_{k} \sum_{\mathbf{\pi}\in \mathcal{P}_{n,k}} \binom{k}{\pi_{1},\pi_{2}, \ldots, \pi_{n}} b_{1}^{\pi_{1}} b_{2}^{\pi_{2}}\cdots b_{n}^{\pi_{n}},$

where

: $\mathcal{P}_{n,k}=\{(\pi_1,\pi_2,\dots,\pi_n)\,:\ \pi_1+\pi_2+ \cdots + \pi_n=k,\ \pi_{1}\cdot 1+\pi_{2}\cdot 2+ \cdots + \pi_{n}\cdot n = n \}$

is the set of partitions of $n$ into $k$ parts, in frequency-of-parts form.

The first form is obtained by picking out the coefficient of $x^n$

in $(b_{1}x+b_{2}x^2+ \cdots)^{k}$ "by inspection", and the second form

is then obtained by collecting like terms, or alternatively, by applying the multinomial theorem.

The special case $f(x)=e^x$ , $g(x)=\sum_{n\geq 1}\frac{1}{n!}a_n x^n$ gives the exponential formula.

The special case $f(x)=1/(1-x)$ , $g(x)=\sum_{n\geq 1} (-a_n) x^n$

gives an expression for the reciprocal of the formal power series

$\sum_{n\geq 0} a_n x^n$ in the case $a_0=1$ .

StanleySee the "compositional formula" in Chapter 5 of {{cite book |last=Stanley |first=Richard P. |title=Enumerative Combinatorics |orig-year=1997 |year=1999 |isbn=978-0-521-55309-4|publisher=Cambridge University Press |url=http://www-math.mit.edu/~rstan/ec/}}

gives a version for exponential power series.

In the formal power series

: $f(x)=\sum_n {\frac{a_n}{n!}}x^n,$

we have the $n$ th derivative at 0:

: $f^{(n)}(0)=a_n.$

This should not be construed as the value of a function, since these series are purely formal; there is no such thing as convergence or divergence in this context.

: $g(x)=\sum_{n=0}^\infty {\frac{b_n}{n!}} x^n$

and

: $f(x)=\sum_{n=1}^\infty {\frac{a_n}{n!}} x^n$

and

: $g(f(x))=h(x)=\sum_{n=0}^\infty{\frac{c_n}{n!}}x^n,$

then the coefficient $c_n$ (which would be the $n$ th derivative of $h$ evaluated at 0 if we were dealing with convergent series rather than formal power series) is given by

: $c_n=\sum_{\pi=\left\{B_1,\ldots,B_k\right\}} a_{\left|B_1\right|}\cdots a_{\left|B_k\right|} b_k$

where $\pi$ runs through the set of all partitions of the set $\{1,\ldots,n\}$ and $B_1,\ldots,B_k$

are the blocks of the partition $\pi$ , and $|B_j|$

is the number of members of the $j$ th block, for $j=1,\ldots,k$ .

This version of the formula is particularly well suited to the purposes of combinatorics.

We can also write with respect to the notation above

: $g(f(x)) = b_0+ \sum_{n=1}^\infty \frac{\sum_{k=1}^n b_k B_{n,k}(a_1,\ldots,a_{n-k+1})}{n!} x^n,$

where $B_{n,k}(a_1,\ldots,a_{n-k+1})$ are Bell polynomials.

=A special case=

If $f(x) = e^x$ , then all of the derivatives of $f$ are the same and are a factor common to every term:

: ${d^n \over dx^n} e^{g(x)} = e^{g(x)} B_{n} \left(g'(x),g''(x), \dots, g^{(n)}(x)\right),$

where $B_n(x)$ is the nth complete exponential Bell polynomial.

In case $g(x)$ is a cumulant-generating function, then $f(g(x))$

is a moment-generating function, and the polynomial in various derivatives of $g$ is the polynomial that expresses the moments as functions of the cumulants.

Notes

References

=Historical surveys and essays=

{{Citation

| last = Brigaglia

| first = Aldo

| editor-last = Giacardi

| editor-first = Livia

| contribution = L'Opera Matematica

| title = Francesco Faà di Bruno. Ricerca scientifica insegnamento e divulgazione

| place = Torino

| language = it

| publisher = Deputazione Subalpina di Storia Patria

| year = 2004

| series = Studi e fonti per la storia dell'Università di Torino

| volume = XII

| pages = 111–172}}. "The mathematical work" is an essay on the mathematical activity, describing both the research and teaching activity of Francesco Faà di Bruno.

{{Citation

| first=Alex D. D.

| last=Craik

| title=Prehistory of Faà di Bruno's Formula

| journal=American Mathematical Monthly

| volume=112

| date=February 2005

| pages=217–234

| issue=2

| jstor = 30037410

| doi=10.2307/30037410

| mr= 2121322

| zbl= 1088.01008

}}.

{{Citation

| last = Johnson

| first = Warren P.

| title = The Curious History of Faà di Bruno's Formula

| journal = American Mathematical Monthly

| volume = 109

| issue = 3

| pages = 217–234

| date=March 2002

| url = https://www.maa.org/sites/default/files/pdf/upload_library/22/Ford/Johnson217-234.pdf

| jstor = 2695352

| doi = 10.2307/2695352

| mr = 1903577

| zbl = 1024.01010

| citeseerx = 10.1.1.109.4135

}}.

=Research works=

{{Citation

| first = L. F. A.

| last=Arbogast

| author-link= Louis François Antoine Arbogast

| title=Du calcul des derivations

| trans-title=On the calculus of derivatives

| year=1800

| language=fr

| publisher=Levrault

| place=Strasbourg

| url=https://books.google.com/books?id=YoPq8uCy5Y8C

| pages= xxiii+404

}}, Entirely freely available from Google books.

{{Citation

| first=F.

| last=Faà di Bruno

| author-link=Francesco Faà di Bruno

| title= Sullo sviluppo delle funzioni

| trans-title=On the development of the functions

| language = it

| journal= Annali di Scienze Matematiche e Fisiche

| lccn=06036680

| volume= 6

| year= 1855

| pages= 479–480

| url = https://books.google.com/books?id=ddE3AAAAMAAJ&pg=PA479

}}. Entirely freely available from Google books. A well-known paper where Francesco Faà di Bruno presents the two versions of the formula that now bears his name, published in the journal founded by Barnaba Tortolini.

{{Citation

| first=F.

| last=Faà di Bruno

| title= Note sur une nouvelle formule de calcul differentiel

| trans-title=On a new formula of differential calculus

| language = fr

| journal= The Quarterly Journal of Pure and Applied Mathematics

| volume= 1

| year=1857

| pages= 359–360

| url = https://books.google.com/books?id=7BELAAAAYAAJ&pg=PA359

}}. Entirely freely available from Google books.

{{Citation

| first = Francesco

| last= Faà di Bruno

| title=Théorie générale de l'élimination

| trans-title=General elimination theory

| year=1859

| language= fr

| publisher=Leiber et Faraguet

| place=Paris

| url=https://books.google.com/books?id=MZ0KAAAAYAAJ

| pages= x+224

}}. Entirely freely available from Google books.

Flanders, Harley (2001) "From Ford to Faa", American Mathematical Monthly 108(6): 558–61 {{doi|10.2307/2695713}}
{{Citation

| last = Fraenkel

| first = L. E.

| title = Formulae for high derivatives of composite functions

| journal = Mathematical Proceedings of the Cambridge Philosophical Society

| volume = 83

| issue = 2

| pages = 159–165

| year = 1978

| doi = 10.1017/S0305004100054402

| bibcode = 1978MPCPS..83..159F

| mr = 0486377

| zbl = 0388.46032

| s2cid = 121007038

}}.

{{Citation

| last1 = Krantz

| first1 = Steven G.

| author1-link = Steven G. Krantz

| last2 = Parks

| first2 = Harold R.

| author2-link = Harold R. Parks

| title = A Primer of Real Analytic Functions

| place = Boston

| publisher = Birkhäuser Verlag

| year = 2002

| series = Birkhäuser Advanced Texts - Basler Lehrbücher

| edition = Second

| pages = xiv+205

| url = https://books.google.com/books?id=i4vw2STJl2QC

| mr = 1916029

| zbl = 1015.26030

| isbn = 978-0-8176-4264-8

}}

{{Citation

| last = Porteous

| first = Ian R.

| author-link = Ian Robertson Porteous

| title = Geometric Differentiation

| place = Cambridge

| publisher = Cambridge University Press

| year = 2001

| edition = Second

| chapter = Paragraph 4.3: Faà di Bruno's formula

| chapter-url = https://books.google.com/books?id=BNrW0UJ_UFcC&pg=PA83

| pages = 83–85

| url = https://books.google.com/books?id=BNrW0UJ_UFcC

| mr = 1871900

| zbl = 1013.53001

| isbn = 978-0-521-00264-6

}}.

{{Citation

| last = T. A.

| first = (Tiburce Abadie, J. F. C.)

| title = Sur la différentiation des fonctions de fonctions

| trans-title=On the derivation of functions

| language = fr

| journal = Nouvelles annales de mathématiques, journal des candidats aux écoles polytechnique et normale

| series = Série 1

| volume = 9

| pages = 119–125

| year = 1850

| url = http://www.numdam.org/item?id=NAM_1850_1_9__119_1

}}, available at [http://www.numdam.org NUMDAM]. This paper, according to {{harvtxt|Johnson|2002|p=228}} is one of the precursors of {{harvnb|Faà di Bruno|1855}}: note that the author signs only as "T.A.", and the attribution to J. F. C. Tiburce Abadie is due again to Johnson.

{{Citation

| last = A.

| first = (Tiburce Abadie, J. F. C.)

| title = Sur la différentiation des fonctions de fonctions. Séries de Burmann, de Lagrange, de Wronski

| trans-title=On the derivation of functions. Burmann, Lagrange and Wronski series.

| language = fr

| journal = Nouvelles annales de mathématiques, journal des candidats aux écoles polytechnique et normale

| series = Série 1

| volume = 11

| pages = 376–383

| year = 1852

| url = http://www.numdam.org/item?id=NAM_1852_1_11__376_1

}}, available at [http://www.numdam.org NUMDAM]. This paper, according to {{harvtxt|Johnson|2002|p=228}} is one of the precursors of {{harvnb|Faà di Bruno|1855}}: note that the author signs only as "A.", and the attribution to J. F. C. Tiburce Abadie is due again to Johnson.