Generalized additive model for location, scale and shape

{{Use dmy dates|date=July 2020}}

The generalized additive model for location, scale and shape (GAMLSS) is a semiparametric regression model in which a parametric statistical distribution is assumed for the response (target) variable but the parameters of this distribution can vary according to explanatory variables. GAMLSS is a form of supervised machine learning.

GAMLSS enables flexible regression and smoothing models to be fitted to the data. GAMLSS assumes the response variable follows an arbitrary parametric distribution, which might be heavy or light-tailed, and positively or negatively skewed. In addition, all the parameters of the distribution – location (e.g., mean), scale (e.g., variance) and shape (skewness and kurtosis) – can be modeled as linear, nonlinear or smooth functions of explanatory variables.

Overview of the model

The generalized additive model for location, scale and shape (GAMLSS) is a statistical model developed by Rigby and Stasinopoulos (and later expanded) to overcome some of the limitations associated with the popular generalized linear models (GLMs) and generalized additive models (GAMs). For an overview of these limitations see Nelder and Wedderburn (1972){{cite journal|last1=Nelder|first1=J.A.|last2=Wedderburn|first2=R.W.M|title=Generalized linear models|journal=J. R. Stat. Soc. A|year=1972|volume=135|issue=3|pages=370–384|doi=10.2307/2344614|jstor=2344614}} and Hastie's and Tibshirani's book.{{cite book|last1=Hastie|first1=TJ|last2=Tibshirani|first2=RJ|title=Generalized additive models|year=1990|publisher=Chapman and Hall|location=London}}

In GAMLSS the exponential family distribution assumption for the response variable, (y), (essential in GLMs and GAMs), is relaxed and replaced by a general distribution family, including highly skew and/or kurtotic continuous and discrete distributions.

The systematic part of the model is expanded to allow modeling not only of the mean (or location) but other parameters of the distribution of y as linear and/or nonlinear, parametric and/or additive non-parametric functions of explanatory variables and/or random effects.

GAMLSS is especially suited for modelling a leptokurtic or platykurtic and/or positively or negatively skewed response variable. For count type response variable data it deals with over-dispersion by using proper over-dispersed discrete distributions. Heterogeneity also is dealt with by modeling the scale or shape parameters using explanatory variables. There are several packages written in R related to GAMLSS models,{{cite journal|last2=Rigby|first2=Robert A|date=December 2007|title=Generalized additive models for location scale and shape (GAMLSS) in R|journal=Journal of Statistical Software|volume=23|issue=7|doi=10.18637/jss.v023.i07|last1=Stasinopoulos|first1=D. Mikis|doi-access=free}} and tutorials for using and interpreting GAMLSS.{{cite journal |last1=David |first1=Bann |last2=Liam |first2=Wright |last3=Tim J |first3=Cole |title=Risk factors relate to the variability of health outcomes as well as the mean: A GAMLSS tutorial |journal=eLife |date=2022 |volume=11 |issue=11 |doi=10.7554/eLife.72357 |pmid=34985412 |pmc=8791632 |doi-access=free }}

A GAMLSS model assumes independent observations y_i for i = 1, 2, \dots , n

with probability (density) function f (y_i | \mu_i , \sigma_i , \nu_i , \tau_i ) conditional on (\mu_i , \sigma_i , \nu_i , \tau_i ) a vector of four distribution parameters, each of which can be a function of the explanatory variables. The first two population distribution parameters \mu_i and \sigma_i are usually characterized as location and scale parameters, while the remaining parameter(s), if any, are characterized as shape parameters, e.g. skewness and kurtosis parameters, although the model may be applied more generally to the parameters of any population distribution with up to four distribution parameters, and can be generalized to more than four distribution parameters.

:

\begin{align}

g_1 (\mu) = \eta_1= X_1 \beta_1 + \sum_{j=1}^{J_1} {h}_{j1}(x_{j1}) \\

g_2(\sigma) = \eta_2= X_2 \beta_2 + \sum_{j=1}^{J_2}{h}_{j2}(x_{j2}) \\

g_3(\nu) = \eta_3 = X_3 \beta_3 + \sum_{j=1}^{J_3}{h}_{j3}(x_{j3}) \\

g_4(\tau)=\eta_4=X_4 \beta_4 + \sum_{j=1}^{J_4}{h}_{j4}(x_{j4})

\end{align}

where μ, σ, ν, τ and \eta_k are vectors of length n, \beta^{T}_k = (\beta_{1k},\beta_{2k},\ldots,\beta_{J'_{k}

k}) is a parameter vector of length J'_k, X_k is a fixed known design matrix of order n \times J'_k and h_{jk} is a smooth non-parametric function of explanatory variable x_{jk}, j=1,2,\ldots, J_{k} and k=1,2,3,4.

g_i are link functions.

For centile estimation the [https://www.who.int/childgrowth/en WHO Multicentre Growth Reference Study Group] have recommended GAMLSS and the Box–Cox power exponential (BCPE) distributions{{cite journal|last2=Stasinopoulos|first2=D. Mikis|date=February 2004|title=Smooth Centile Curves for Skew and Kurtotic data Modelled Using the Box–Cox Power Exponential Distribution|journal=Statistics in Medicine|volume=23|issue=19|pages=3053–3076|doi=10.1002/sim.1861|pmid=15351960|last1=Rigby|first1=Robert}} for the construction of the WHO Child Growth Standards.{{Cite journal | last1 = Borghi | first1 = E. | last2 = De Onis | first2 = M. | last3 = Garza | first3 = C. | last4 = Van Den Broeck | first4 = J. | last5 = Frongillo | first5 = E. A. | last6 = Grummer-Strawn | first6 = L. | last7 = Van Buuren | first7 = S. | last8 = Pan | first8 = H. | last9 = Molinari | first9 = L. | doi = 10.1002/sim.2227 | last10 = Martorell | first10 = R. | last11 = Onyango | first11 = A. W. | last12 = Martines | first12 = J. C. | author13 = WHO Multicentre Growth Reference Study Group | title = Construction of the World Health Organization child growth standards: Selection of methods for attained growth curves | journal = Statistics in Medicine | volume = 25 | issue = 2 | pages = 247–265 | year = 2006 | pmid = 16143968}}WHO Multicentre Growth Reference Study Group (2006) WHO Child Growth Standards: Length/height-for-age, weight-for-age, weight-for-length, weight-for-height and body mass index-for-age: Methods and development. Geneva: World Health Organization.

What distributions can be used

The form of the distribution assumed for the response variable y, is very general. For example, an implementation of GAMLSS in R{{Cite web|url=https://www.gamlss.com/distributions/|title=The R packages {{!}} gamlss|website=The R packages {{!}} gamlss|access-date=2020-05-04}} has around 100 different distributions available. Such implementations also allow use of truncated distributions and censored (or interval) response variables.

References

{{reflist}}

Further reading

  • {{cite journal | last1 = Beyerlein | first1 = A. | last2 = Fahrmeir | first2 = L. | last3 = Mansmann | first3 = U. | last4 = Toschke | first4 = A. M. | year = 2001 | title = Alternative regression models to assess increase in childhood BM | journal = BMC Medical Research Methodology | volume = 8| page = 59| doi = 10.1186/1471-2288-8-59 | pmid = 18778466 | pmc = 2543035 | doi-access = free }}
  • Cole, T. J., Stanojevic, S., Stocks, J., Coates, A. L., Hankinson, J. L., Wade, A. M. (2009), "Age- and size-related reference ranges: A case study of spirometry through childhood and adulthood", Statistics in Medicine, 28(5), 880–898.[https://archive.today/20130105085453/http://www3.interscience.wiley.com/journal/121547617/abstract Link]
  • Fenske, N., Fahrmeir, L., Rzehak, P., Hohle, M. (25 September 2008), "Detection of risk factors for obesity in early childhood with quantile regression methods for longitudinal data", Department of Statistics: Technical Reports, No.38 [http://epub.ub.uni-muenchen.de/6260/ Link]
  • Hudson, I. L., Kim, S. W., Keatley, M. R. (2010), "Climatic Influences on the Flowering Phenology of Four Eucalypts: A GAMLSS Approach Phenological Research". In Phenological Research, Irene L. Hudson and Marie R. Keatley (eds), Springer Netherlands [https://doi.org/10.1007%2F978-90-481-3335-2_10 Link]
  • Hudson, I. L., Rea, A., Dalrymple, M. L., Eilers, P. H. C. (2008), "Climate impacts on sudden infant death syndrome: a GAMLSS approach", Proceedings of the 23rd international workshop on statistical modelling pp. 277–280. [http://arrow.unisa.edu.au:8081/1959.8/62400 Link]
  • {{cite journal | last1 = Nott | first1 = D | year = 2006 | title = Semiparametric estimation of mean and variance functions for non-Gaussian data | journal = Computational Statistics | volume = 21 | issue = 3–4| pages = 603–620 | doi=10.1007/s00180-006-0017-9| citeseerx = 10.1.1.117.6518 | s2cid = 16900583 }}
  • {{cite journal | last1 = Serinaldi | first1 = F | year = 2011 | title = Distributional modeling and short-term forecasting of electricity prices by Generalized Additive Models for Location, Scale and Shape | journal = Energy Economics | volume = 33 | issue = 6| pages = 1216–1226 | doi = 10.1016/j.eneco.2011.05.001 }}
  • {{cite journal | last1 = Serinaldi | first1 = F. | last2 = Cuomo | first2 = G. | year = 2011 | title = Characterizing impulsive wave-in-deck loads on coastal bridges by probabilistic models of impact maxima and rise times | journal = Coastal Engineering | volume = 58 | issue = 9| pages = 908–926 | doi = 10.1016/j.coastaleng.2011.05.010 }}
  • Serinaldi, F., Villarini, G., Smith, J. A., Krajewski, W. F. (2008), "Change-Point and Trend Analysis on Annual Maximum Discharge in Continental United States", American Geophysical Union Fall Meeting 2008, abstract #H21A-0803*
  • {{cite journal | last1 = van Ogtrop | first1 = F. F. | last2 = Vervoort | first2 = R. W. | last3 = Heller | first3 = G. Z. | last4 = Stasinopoulos | first4 = D. M. | last5 = Rigby | first5 = R. A. | year = 2011 | title = Long-range forecasting of intermittent streamflow | journal = Hydrology and Earth System Sciences Discussions | volume = 8 | issue = 1| pages = 681–713 | doi = 10.5194/hessd-8-681-2011 | doi-access = free }}
  • {{cite journal | last1 = Villarini | first1 = G. | last2 = Serinaldi | first2 = F. | year = 2011 | title = Development of statistical models for at-site probabilistic seasonal rainfall forecast | journal = International Journal of Climatology | volume = 32 | issue = 14 | pages = 2197–2212 | doi = 10.1002/joc.3393 | doi-access = free }}
  • {{cite journal | last1 = Villarini | first1 = G. | last2 = Serinaldi | first2 = F. | last3 = Smith | first3 = J. A. | last4 = Krajewski | first4 = W. F. | year = 2009 | title = On the stationarity of annual flood peaks in the continental United States during the 20th century | url = http://www.agu.org/pubs/crossref/2009/2008WR007645.shtml | journal = Water Resources Research | volume = 45 | issue = 8| doi = 10.1029/2008wr007645 | bibcode = 2009WRR....45.8417V | doi-access = free }}
  • {{cite journal | last1 = Villarini | first1 = G. | last2 = Smith | first2 = J. A. | last3 = Napolitano | first3 = F. | year = 2010 | title = Nonstationary modeling of a long record of rainfall and temperature over Rome | journal = Advances in Water Resources | volume = 33| issue = 10| pages = 1256–1267| doi = 10.1016/j.advwatres.2010.03.013 | bibcode = 2010AdWR...33.1256V }}