Hyperbolastic functions
{{Short description|Mathematical functions}}
File:Figure 1 - Hyperbolastic Type I.png
File:Figure 2 - Hyperbolastic Type I.png
File:Figure 3 - Hyperbolastic Type II.png
File:Figure 4 - Hyperbolastic Type II.png
File:Figure 5 - Hyperbolastic Type III.png
File:Figure 6 - Hyperbolastic Type III.png
File:Figure 7 - Hyperbolastic Type III.png
The hyperbolastic functions, also known as hyperbolastic growth models, are mathematical functions that are used in medical statistical modeling. These models were originally developed to capture the growth dynamics of multicellular tumor spheres, and were introduced in 2005 by Mohammad Tabatabai, David Williams, and Zoran Bursac.{{Cite journal |doi = 10.1186/1742-4682-2-14 |year = 2005 |last1 = Tabatabai |first1 = Mohammad |last2 = Williams |first2 = David |last3 = Bursac |first3 = Zoran |title = Hyperbolastic growth models: Theory and application |journal = Theoretical Biology and Medical Modelling |volume = 2 |pages = 14 |pmid = 15799781 |pmc = 1084364 |doi-access = free }} The precision of hyperbolastic functions in modeling real world problems is somewhat due to their flexibility in their point of inflection.{{Cite journal | issn = 2950-7154| title= Performance of the Survival models in Socioeconomic Phenomena | year=2022| last1= Himali| first1=L.P.| last2= Xia| first2= Zhiming | journal= Vavuniya Journal of Science | volume=1 | issue = 2| pages = 9–19| doi= 10.4038/vjs.v1i2.9 | doi-access= free}} These functions can be used in a wide variety of modeling problems such as tumor growth, stem cell proliferation, pharma kinetics, cancer growth, sigmoid activation function in neural networks, and epidemiological disease progression or regression.{{cite book |last1=Acton |first1=Q. Ashton |title=Blood Cells—Advances in Research and Application: 2012 Edition |date=2012 |publisher=ScholarlyEditions |isbn=978-1-4649-9316-9 }}{{page needed|date=May 2023}}{{Cite journal | title=An introduction to the mathematical modelling of iPSCs| journal= Recent Advances in IPSC Technology| year=2020| volume=5| last1=Wadkin| first1=L. E.| last2=Orozco-Fuentes| first2=S.| last3=Neganova| first3=I.| last4=Lako| first4=M.|last5 = Parker|first5=N. G.|last6=Shukurov|first6=A.| arxiv= 2010.15493}}
The hyperbolastic functions can model both growth and decay curves until it reaches carrying capacity. Due to their flexibility, these models have diverse applications in the medical field, with the ability to capture disease progression with an intervening treatment. As the figures indicate, hyperbolastic functions can fit a sigmoidal curve indicating that the slowest rate occurs at the early and late stages.{{Cite journal | title=Study of a General Growth Model| journal= Communications in Nonlinear Science and Numerical Simulation| year=2022| volume=107| last1=Albano| first1=G.| last2=Giorno| first2=V.| last3=Roman-Roman| first3=P.| last4=Torres-Ruiz| first4=F.|doi=10.1016/j.cnsns.2021.106100| arxiv=2402.00882| bibcode= 2022CNSNS.10706100A}} In addition to the presenting sigmoidal shapes, it can also accommodate biphasic situations where medical interventions slow or reverse disease progression; but, when the effect of the treatment vanishes, the disease will begin the second phase of its progression until it reaches its horizontal asymptote.
One of the main characteristics these functions have is that they cannot only fit sigmoidal shapes, but can also model biphasic growth patterns that other classical sigmoidal curves cannot adequately model. This distinguishing feature has advantageous applications in various fields including medicine, biology, economics, engineering, agronomy, and computer aided system theory.{{Cite journal |doi = 10.1099/mic.0.25880-0|title = Biphasic kinetics of growth and bacteriocin production with Lactobacillus amylovorus DCE 471 occur under stress conditions|year = 2003|last1 = Neysens|first1 = Patricia|last2 = Messens|first2 = Winy|last3 = Gevers|first3 = Dirk|last4 = Swings|first4 = Jean|last5 = De Vuyst|first5 = Luc|journal = Microbiology|volume = 149|issue = 4|pages = 1073–1082|pmid = 12686649|doi-access = free}}{{cite journal |last1=Chu |first1=Charlene |last2=Han |first2=Christina |last3=Shimizu |first3=Hiromi |last4=Wong |first4=Bonnie |title=The Effect of Fructose, Galactose, and Glucose on the Induction of β-Galactosidase in Escherichia coli |url=https://www.microbiology.ubc.ca/sites/default/files/roles/drupal_ungrad/JEMI/2/2-1.pdf |year=2002 |journal=Journal of Experimental Microbiology and Immunology |volume=2 |pages=1–5}}{{Cite journal | doi=10.3934/mbe.2013.10.925| title=T model of growth and its application in systems of tumor-immunedynamics| journal=Mathematical Biosciences and Engineering| year=2013| volume=10| issue=3| pages=925–938| pmid=23906156| last1=Tabatabai| first1=M. A.| last2=Eby| first2=W. M.| last3=Singh| first3=K. P.| last4=Bae| first4=S.| pmc=4476034}}{{Cite journal | doi=10.1051/ocl/2020053| title=Effects of cadmium toxicity on sesame seed germination explained by various nonlinear growth models| journal=Oilseeds & Fats Crops and Lipids| year=2020| volume=27| issue=57| last1=Parmoon| first1=Ghasem| last2=Moosavi| first2=Seyed| last3=Poshtdar| first3=Adel| last4=Siadat| first4= Seyed| page=57| doi-access=free}}{{Cite book |doi = 10.1007/978-3-030-45093-9|title = Computer Aided Systems Theory – EUROCAST 2019|series = Lecture Notes in Computer Science|year = 2020|volume = 12013| arxiv=2107.06131 |isbn = 978-3-030-45092-2| s2cid=215791712 | last1=Kronberger | first1=Gabriel | last2=Kammerer | first2=Lukas | last3=Kommenda | first3=Michael }}
Function H1
The hyperbolastic rate equation of type I, denoted H1, is given by
where is any real number and
is the population size at . The parameter represents carrying capacity, and parameters and jointly represent growth rate. The parameter gives the distance from a symmetric sigmoidal curve. Solving the hyperbolastic rate equation of type I for gives
where is the inverse hyperbolic sine function. If one desires to use the initial condition , then can be expressed as
:.
If , then reduces to
:.
In the event that a vertical shift is needed to give a better model fit, one can add the shift parameter , which would result in the following formula
:.
The hyperbolastic function of type I generalizes the logistic function. If the parameters , then it would become a logistic function. This function is a hyperbolastic function of type I. The standard hyperbolastic function of type I is
:.
Function H2
The hyperbolastic rate equation of type II, denoted by H2, is defined as
:
where is the hyperbolic tangent function, is the carrying capacity, and both and jointly determine the growth rate. In addition, the parameter represents acceleration in the time course. Solving the hyperbolastic rate function of type II for gives
:
.
If one desires to use initial condition
P(x_0)=P_0, then can be expressed as
:
.
If , then reduces to
:.
Similarly, in the event that a vertical shift is needed to give a better fit, one can use the following formula
:
.
The standard hyperbolastic function of type II is defined as
:
.
Function H3
The hyperbolastic rate equation of type III is denoted by H3 and has the form
:,
where > 0. The parameter represents the carrying capacity, and the parameters and jointly determine the growth rate. The parameter represents acceleration of the time scale, while the size of represents distance from a symmetric sigmoidal curve. The solution to the differential equation of type III is
:,
with the initial condition
P\left(t_0\right)=P_0 we can express as
:.
The hyperbolastic distribution of type III is a three-parameter family of continuous probability distributions with scale parameters > 0, and ≥ 0 and parameter as the shape parameter. When the parameter = 0, the hyperbolastic distribution of type III is reduced to the weibull distribution.Kamar SH, Msallam BS. Comparative Study between Generalized Maximum Entropy and Bayes Methods to Estimate the Four Parameter Weibull Growth Model. Journal of Probability and Statistics. 2020 Jan 14;2020:1–7. The hyperbolastic cumulative distribution function of type III is given by
:
\begin{cases}
1- e^{-\delta x^\gamma - \operatorname{arsinh}(\theta x)} & x\geq0 ,\\
0 & x < 0
\end{cases}
,
and its corresponding probability density function is
:
f(x; \delta, \gamma, \theta) =
\begin{cases}
e^{- \delta x^\gamma - \operatorname{arsinh}(\theta x)}\left(\delta \gamma x^{\gamma-1}+ \frac{\theta}{\sqrt{1+\theta^2 x^2}}\right) & x\geq0 ,\\
0 & x<0
\end{cases}.
The hazard function (or failure rate) is given by
:
The survival function is given by
:
The standard hyperbolastic cumulative distribution function of type III is defined as
:,
and its corresponding probability density function is
:
f(x) = e^{- x - \operatorname{arsinh}(x)}\left(1+ \frac{1}{\sqrt{1+ x^2}}\right) .
Properties
If one desires to calculate the point where the population reaches a percentage of its carrying capacity , then
one can solve the equation
:
for , where . For instance, the half point can be found by setting .
Applications
File:3D Hyperbolastic Graph of Phytoplankton Biomass.png
According to stem cell researchers at McGowan Institute for Regenerative Medicine at the University of Pittsburgh, "a newer model [called the hyperbolastic type III or] H3 is a differential equation that also describes the cell growth. This model allows for much more variation and has been proven to better predict growth."{{cite web |vauthors=Roehrs T, Bogdan P, Gharaibeh B, et al. |date=n.d. |title=Proliferative heterogeneity in stem cell populations |url=https://www.engineering.pitt.edu/Departments/Bioengineering/_Documents/Undergraduate-research/Intramural-Internships/(2131)---Fall2012/Abstract_Roehrs |publisher=Live Cell Imaging Laboratory, McGowan Institute for Regenerative Medicine}}
The hyperbolastic growth models H1, H2, and H3 have been applied to analyze the growth of solid Ehrlich carcinoma using a variety of treatments.{{Cite journal |doi = 10.1186/1471-2407-10-509|title = Hyperbolastic modeling of tumor growth with a combined treatment of iodoacetate and dimethylsulphoxide|year = 2010|last1 = Eby|first1 = Wayne M.|last2 = Tabatabai|first2 = Mohammad A.|last3 = Bursac|first3 = Zoran|journal = BMC Cancer|volume = 10|pages = 509|pmid = 20863400|pmc = 2955040 | doi-access=free }}
In animal science,{{cite book |editor-last=France |editor-first=James |editor-last2=Kebreab |editor-first2=Ermias |title=Mathematical Modelling in Animal Nutrition |url=https://www.researchgate.net/publication/40802178 |location=Wallingford |publisher=CABI |year=2008 |isbn=9781845933548}} the hyperbolastic functions have been used for modeling broiler chicken growth.{{Cite journal |doi = 10.3382/ps.2007-00086|title = Hyperbolastic Models as a New Powerful Tool to Describe Broiler Growth Kinetics|year = 2007|last1 = Ahmadi|first1 = H.|last2 = Mottaghitalab|first2 = M.|journal = Poultry Science|volume = 86|issue = 11|pages = 2461–2465|pmid = 17954598|doi-access = free}}{{Cite journal |doi = 10.31548/ujvs2021.04.002|title = Approximation of Growth Indicators and Analysis of Individual Growth Curves by Linear Dimensions of Tubular Bones in Chickens of Meat Production Direction During Postnatal Period of Ontogenesis|year = 2021|last1 = Tkachuk|first1 = S. A.|last2 = Pasnichenko|first2 = O. S.| last3 = Savchok | first3 = L. B. |journal = Ukrainian Journal of Veterinary Sciences | volume = 12|issue = 4| s2cid=245487460 |doi-access = free}} The hyperbolastic model of type III was used to determine the size of the recovering wound.{{Cite journal | doi=10.1155/2014/965036| title=Novel Real-Time Facial Wound Recovery Synthesis Using Subsurface Scattering| year=2014| last1=Choi| first1=Taeyoung| last2=Chin| first2=Seongah| journal=The Scientific World Journal| volume=2014| pages=1–8| pmid=25197721| pmc=4146479| doi-access=free}}
In the area of wound healing, the hyperbolastic models accurately representing the time course of healing. Such functions have been used to investigate variations in the healing velocity among different kinds of wounds and at different stages in the healing process taking into consideration the areas of trace elements, growth factors, diabetic wounds, and nutrition.{{Cite journal |doi = 10.1016/j.mcm.2010.10.013|title = Hyperbolastic modeling of wound healing|year = 2011|last1 = Tabatabai|first1 = M.A.|last2 = Eby|first2 = W.M.|last3 = Singh|first3 = K.P.|journal = Mathematical and Computer Modelling|volume = 53|issue = 5–6|pages = 755–768|doi-access = free}}{{Cite journal | doi=10.1038/s41598-019-52523-9| title=Physicochemically Tuned Myofibroblasts for Wound Healing Strategy| year=2019| last1=Ko| first1=Ung Hyun| last2=Choi| first2=Jongjin| last3=Choung| first3=Jinseung| last4=Moon| first4=Sunghwan| last5=Shin| first5=Jennifer H.| journal=Scientific Reports| volume=9| issue=1| pages=16070| pmid=31690789| pmc=6831678| bibcode=2019NatSR...916070K}}
Another application of hyperbolastic functions is in the area of the stochastic diffusion process,{{Cite journal |doi = 10.3390/math9161835|title = Hyperbolastic Models from a Stochastic Differential Equation Point of View|year = 2021|last1 = Barrera|first1 = Antonio|last2 = Román-Román|first2 = Patricia|last3 = Torres-Ruiz |first3 = Francisco|journal = Mathematics|volume = 9|issue = 16|pages = 1835|doi-access = free}} whose mean function is a hyperbolastic curve. The main characteristics of the process are studied and the maximum likelihood estimation for the parameters of the process is considered.{{Cite book |doi = 10.1007/978-3-030-45093-9_25|chapter = Diffusion Processes for Weibull-Based Models|title = Computer Aided Systems Theory – EUROCAST 2019|series = Lecture Notes in Computer Science|year = 2020|last1 = Barrera|first1 = Antonio|last2 = Román-Román|first2 = Patricia|last3 = Torres-Ruiz|first3 = Francisco|volume = 12013|pages = 204–210|isbn = 978-3-030-45092-2| s2cid=215792096 }}
To this end, the firefly metaheuristic optimization algorithm is applied after bounding the parametric space by a stage wise procedure. Some examples based on simulated sample paths and real data illustrate this development. A sample path of a diffusion process models the trajectory of a particle embedded in a flowing fluid and subjected to random displacements due to collisions with other particles, which is called Brownian motion.{{Cite journal |doi = 10.1016/j.biosystems.2017.11.001|title = A hyperbolastic type-I diffusion process: Parameter estimation by means of the firefly algorithm|year = 2018|last1 = Barrera|first1 = Antonio|last2 = Román-Román|first2 = Patricia|last3 = Torres-Ruiz|first3 = Francisco|journal = Biosystems|volume = 163|pages = 11–22|pmid = 29129822|arxiv = 2402.03416| bibcode=2018BiSys.163...11B }}{{Cite journal | doi=10.3934/mbe.2020043| title=Hyperbolastic type-III diffusion process: Obtaining from the generalized Weibull diffusion process| year=2020| last1=Barrera| first1=Antonio| last2=Román-Roán| first2=Patricia| last3=Torres-Ruiz| first3=Francisco| journal=Mathematical Biosciences and Engineering| volume=17| issue=1| pages=814–833| pmid=31731379| doi-access=free| hdl=10481/58209| hdl-access=free}}{{Cite journal | doi=10.3390/math8020155| title=Two Stochastic Differential Equations for Modeling Oscillabolastic-Type Behavior| year=2020| last1=Barrera| first1=Antonio| last2=Román-Román| first2=Patricia| last3=Torres-Ruiz| first3=Francisco| journal=Mathematics| volume=8| issue=2| pages=155| doi-access=free| hdl=10481/61054| hdl-access=free}}{{Cite book |doi = 10.3390/books978-3-03921-729-8|title = Stochastic Processes with Applications|year = 2019|isbn = 978-3-03921-729-8|url = https://digitalcommons.uri.edu/cgi/viewcontent.cgi?article=1006&context=nonequilibrium_statistical_physics| doi-access=free }}{{Cite journal | doi=10.3390/math9090959| title=T-Growth Stochastic Model: Simulation and Inference via Metaheuristic Algorithms| year=2021| last1=Barrera| first1=Antonio| last2=Román-Román| first2=Patricia| last3=Torres-Ruiz| first3=Francisco| journal=Mathematics| volume=9| issue=9| pages=959| doi-access=free| hdl=10481/68288| hdl-access=free}} The hyperbolastic function of type III was used to model the proliferation of both adult mesenchymal and embryonic stem cells;{{Cite journal | doi=10.1007/s11517-010-0686-y| title=Mathematical modeling of stem cell proliferation| year=2011| last1=Tabatabai| first1=Mohammad A.| last2=Bursac| first2=Zoran| last3=Eby| first3=Wayne M.| last4=Singh| first4=Karan P.| journal=Medical & Biological Engineering & Computing| volume=49| issue=3| pages=253–262| pmid=20953843| s2cid=33828764}}{{Cite book |doi = 10.1007/978-94-017-8032-2_18|chapter = Methods in Mathematical Modeling for Stem Cells|title = Stem Cells and Cancer Stem Cells, Volume 12 |year = 2014|last1 = Eby|first1 = Wayne M.|last2 = Tabatabai|first2 = Mohammad A.|volume = 12|pages = 201–217|isbn = 978-94-017-8031-5}}{{Cite journal | doi=10.1007/s42452-020-2070-3|pmc=7391994| title=The recent advances in the mathematical modelling of human pluripotent stem cells| year=2020| last1=Wadkin| first1=L. E.| last2=Orozco-Fuentes| first2=S.| last3=Neganova| first3=I.| last4=Lako| first4=M.| last5=Shukurov| first5=A.| last6=Parker| first6=N. G.| journal=SN Applied Sciences| volume=2| issue=2|page=276 |pmid=32803125 | doi-access=free}}{{Cite book | doi=10.1007/978-94-017-8032-2| title=Stem Cells and Cancer Stem Cells, Volume 12| year=2014| volume=12| isbn=978-94-017-8031-5| s2cid=34446642}} and, the hyperbolastic mixed model of type II has been used in modeling cervical cancer data.{{Cite journal |doi = 10.1371/journal.pone.0107242|title = Disparities in Cervical Cancer Mortality Rates as Determined by the Longitudinal Hyperbolastic Mixed-Effects Type II Model|year = 2014|last1 = Tabatabai|first1 = Mohammad A.|last2 = Kengwoung-Keumo|first2 = Jean-Jacques|last3 = Eby|first3 = Wayne M.|last4 = Bae|first4 = Sejong|last5 = Guemmegne|first5 = Juliette T.|last6 = Manne|first6 = Upender|last7 = Fouad|first7 = Mona|last8 = Partridge|first8 = Edward E.|last9 = Singh|first9 = Karan P.|journal = PLOS ONE|volume = 9|issue = 9|pages = e107242|pmid = 25226583|pmc = 4167327|bibcode = 2014PLoSO...9j7242T| doi-access=free }} Hyperbolastic curves can be an important tool in analyzing cellular growth, the fitting of biological curves, the growth of phytoplankton, and instantaneous maturity rate.{{Cite journal |doi = 10.1186/1471-2105-14-283|title = BGFit: Management and automated fitting of biological growth curves|year = 2013|last1 = Veríssimo|first1 = André|last2 = Paixão|first2 = Laura|last3 = Neves|first3 = Ana|last4 = Vinga|first4 = Susana|journal = BMC Bioinformatics|volume = 14|pages = 283|pmid = 24067087|pmc = 3848918 | doi-access=free }}{{Cite journal |doi = 10.3934/mbe.2013.10.913|title = A flexible multivariable model for Phytoplankton growth|journal = Mathematical Biosciences and Engineering|year = 2013|volume = 10|issue = 3|pages = 913–923|pmid = 23906155|last1 = Tabatabai|first1 = M. A.|last2 = Eby|first2 = W. M.|last3 = Bae|first3 = S.|last4 = Singh|first4 = K. P.|doi-access = free}}{{Cite journal |doi = 10.1177/00080683211037203|title = A New Growth Rate Measure in Identifying Extended Gompertz Growth Curve and Development of Goodness-of-fit Test|journal = Calcutta Statistical Association Bulletin|year = 2021|volume = 73|issue = 2|pages = 127–145|last1 = Yeasmin|first1 = Farhana|last2 = Daw|first2 = Ranadeep|last3 = Chakraborty|first3 = Bratati|doi-access = free}}{{cite thesis |last= Arif|first= Samiur|date= 2014|title= Modeling Stem Cell Population Dynamics|publisher= Old Dominion University|url= https://digitalcommons.odu.edu/cgi/viewcontent.cgi?article=1048&context=computerscience_etds|doi = 10.25777/thnx-6q07}}
In forest ecology and management, the hyperbolastic models have been applied to model the relationship between DBH and height.{{Cite journal | doi=10.1016/j.foreco.2017.04.015| title=A new nonlinear model applied to the height-DBH relationship in Gmelina arborea| year=2017| last1=Eby| first1=Wayne M.| last2=Oyamakin| first2=Samuel O.| last3=Chukwu| first3=Angela U.| journal=Forest Ecology and Management| volume=397| pages=139–149| bibcode=2017ForEM.397..139E}}
The multivariable hyperbolastic model type III has been used to analyze the growth dynamics of phytoplankton taking into consideration the concentration of nutrients.{{Cite journal | doi=10.3934/mbe.2013.10.913| title=A flexible multivariable model for Phytoplankton growth| journal=Mathematical Biosciences and Engineering| year=2013| volume=10| issue=3| pages=913–923| pmid=23906155| last1=Tabatabai| first1=M. A.| last2=Eby| first2=W. M.| last3=Bae| first3=S.| last4=Singh| first4=K. P.| doi-access=free}}
Hyperbolastic regressions
File:PDF of H1 Logistic and H2.png
Hyperbolastic regressions are statistical models that utilize standard hyperbolastic functions to model a dichotomous or multinomial outcome variable. The purpose of hyperbolastic regression is to predict an outcome using a set of explanatory (independent) variables. These types of regressions are routinely used in many areas including medical, public health, dental, biomedical, as well as social, behavioral, and engineering sciences. For instance, binary regression analysis has been used to predict endoscopic lesions in iron deficiency anemia.{{Cite journal |doi = 10.1186/1471-230X-8-52|title = Predictors of gastrointestinal lesions on endoscopy in iron deficiency anemia without gastrointestinal symptoms|year = 2008|last1 = Majid|first1 = Shahid|last2 = Salih|first2 = Mohammad|last3 = Wasaya|first3 = Rozina|last4 = Jafri|first4 = Wasim|journal = BMC Gastroenterology|volume = 8|pages = 52|pmid = 18992171|pmc = 2613391 | doi-access=free }} In addition, binary regression was applied to differentiate between malignant and benign adnexal mass prior to surgery.{{Cite journal |doi = 10.1200/JCO.2005.01.7632|title = Logistic Regression Model to Distinguish Between the Benign and Malignant Adnexal Mass Before Surgery: A Multicenter Study by the International Ovarian Tumor Analysis Group|year = 2005|last1 = Timmerman|first1 = Dirk|last2 = Testa|first2 = Antonia C.|last3 = Bourne|first3 = Tom|last4 = Ferrazzi|first4 = Enrico|last5 = Ameye|first5 = Lieveke|last6 = Konstantinovic|first6 = Maja L.|last7 = Van Calster|first7 = Ben|last8 = Collins|first8 = William P.|last9 = Vergote|first9 = Ignace|last10 = Van Huffel|first10 = Sabine|last11 = Valentin|first11 = Lil|journal = Journal of Clinical Oncology|volume = 23|issue = 34|pages = 8794–8801|pmid = 16314639|doi-access = free}}
=The binary hyperbolastic regression of type I=
Let be a binary outcome variable which can assume one of two mutually exclusive values, success or failure. If we code success as and failure as , then for parameter , the hyperbolastic success probability of type I with a sample of size as a function of parameter and parameter vector given a -dimensional vector of explanatory variables is defined as , where , is given by
:.
The odds of success is the ratio of the probability of success to the probability of failure. For binary hyperbolastic regression of type I, the odds of success is denoted by and expressed by the equation
:.
The logarithm of is called the logit of binary hyperbolastic regression of type I. The logit transformation is denoted by and can be written as
:.
==Shannon information for binary hyperbolastic of type I (H1)==
The Shannon information for the random variable is defined as
:
where the base of logarithm and . For binary outcome, is equal to .
For the binary hyperbolastic regression of type I, the information is given by
:
\begin{cases}
-log_b\frac{1}{1+e^{-Z-\theta \operatorname{arsinh}(Z)}} & y = 1 ,\\
-log_b\frac{e^{-Z-\theta \operatorname{arsinh}(Z)}}{1+e^{-Z-\theta \operatorname{arsinh}(Z)}} & y = 0
\end{cases}
,
where , and is the input data.
For a random sample of binary outcomes of size , the average empirical information for hyperbolastic H1 can be estimated by
:
\begin{cases}
-\frac{1}{n}\sum_{i=1}^{n}{log_b\frac{1}{1+e^{-Z_i-\theta \operatorname{arsinh}(Z_i)}}} & y = 1 ,\\
-\frac{1}{n}\sum_{i=1}^{n}{log_b\frac{e^{-Z_i-\theta \operatorname{arsinh}(Z_i)}}{1+e^{-Z_i-\theta \operatorname{arsinh}(Z_i)}}} & y = 0
\end{cases}
,
where , and is the input data for the observation.
====Information Entropy for hyperbolastic H1====
Information entropy measures the loss of information in a transmitted message or signal. In machine learning applications, it is the number of bits necessary to transmit a randomly selected event from a probability distribution. For a discrete random variable , the information entropy is defined as
:
where is the probability mass function for the random variable .
The information entropy is the mathematical expectation of with respect to probability mass function . The Information entropy has many applications in machine learning and artificial intelligence such as classification modeling and decision trees. For the hyperbolastic H1, the entropy is equal to
:
\begin{align}
H & = -\sum_{y \in \{0,1\}}{P(Y=y;\mathbf{x},\boldsymbol{\beta})log_b(P(Y=y;\mathbf{x},\boldsymbol{\beta}))} \\
& = -[\pi(\mathbf{x};\boldsymbol{\beta})\ log_b(\pi(\mathbf{x};\boldsymbol{\beta})+(1-\pi(\mathbf{x};\boldsymbol{\beta}))log_b(1-\pi(\mathbf{x};\boldsymbol{\beta}))] \\
& = {log}_b(1+e^{-Z-\theta \operatorname{arsinh}(Z)})-\frac{e^{-Z-\theta \operatorname{arsinh}(Z)}{log}_b(e^{-Z-\theta \operatorname{arsinh}(Z)})}{1+e^{-Z-\theta \operatorname{arsinh}(Z)}}
\end{align}
The estimated average entropy for hyperbolastic H1 is denoted by and is given by
:
\bar{H}=\frac{1}{n}\sum_{i=1}^{n}{[log_b(1+e^{{-Z}_i-\theta \operatorname{arsinh}(Z_i)})-}\frac{e^{{-Z}_i-\theta \operatorname{arsinh}(Z_i)}\ {log}_b(e^{{-Z}_i-\theta \operatorname{arsinh}((Z_i)})}{1+e^{{-Z}_i-\theta \operatorname{arsinh}(Z_i)}}]
====Binary Cross-entropy for hyperbolastic H1====
The binary cross-entropy compares the observed with the predicted probabilities. The average binary cross-entropy for hyperbolastic H1 is denoted by and is equal to
:
\begin{align}
\overline{C} & =-\frac{1}{n}\sum_{i=1}^{n}{{[y}_i log_b(\pi(x_i;\boldsymbol{\beta}))+}{(1-y}_i)log_b(1-\pi(x_i;\boldsymbol{\beta}))] \\
&=\frac{1}{n}\sum_{i=1}^{n}{[log_b(1+e^{{-Z}_i-\theta \operatorname{arsinh}(Z_i)})-}{(1-y}_i)log_b(e^{{-Z}_i-\theta \operatorname{arsinh}(Z_i)})]
\end{align}
=The binary hyperbolastic regression of type II=
The hyperbolastic regression of type II is an alternative method for the analysis of binary data with robust properties. For the binary outcome variable , the hyperbolastic success probability of type II is a function of a -dimensional vector of explanatory variables given by
: ,
For the binary hyperbolastic regression of type II, the odds of success is denoted by and is defined as
:
The logit transformation is given by
:
==Shannon information for binary hyperbolastic of type II (H2)==
For the binary hyperbolastic regression H2, the Shannon information is given by
:
\begin{cases}
-log_b \frac{1}{1+arsinh(e^{-Z})} & y = 1 \\
-log_b \frac{arsinh(e^{-Z})}{1+arsinh(e^{-Z})} & y = 0
\end{cases}
where , and is the input data.
For a random sample of binary outcomes of size , the average empirical information for hyperbolastic H2 is estimated by
:
\begin{cases}
-\frac{1}{n}\sum_{i=1}^{n}log_b \frac{1}{1+arsinh(e^{-Z_i})} & y = 1 \\
-\frac{1}{n}\sum_{i=1}^{n}log_b \frac{arsinh(e^{-Z_i})}{1+arsinh(e^{-Z_i})} & y=0
\end{cases}
where , and is the input data for the observation.
====Information Entropy for hyperbolastic H2====
For the hyperbolastic H2, the information entropy is equal to
:
\begin{align}
H& = -\sum_{y\in \{0,1\}}{P(Y=y;\mathbf{x} , \boldsymbol{\beta}) log_b(P(Y=y;\mathbf{x} ,\boldsymbol{\beta}))} \\
& =-[\pi(\mathbf{x};\boldsymbol{\beta})\ log_b(\pi(\mathbf{x};\boldsymbol{\beta}))+(1-\pi(\mathbf{x};\boldsymbol{\beta}))log_b(1-\pi(\mathbf{x};\boldsymbol{\beta}))] \\
& =log_b(1+arsinh(e^{-Z}))-\frac{arsinh(e^{-Z}) log_b (arsinh(e^{-Z}))}{1+arsinh(e^{-Z})}
\end{align}
and the estimated average entropy for hyperbolastic H2 is
:
\bar{H}=\frac{1}{n}\sum_{i=1}^{n}{[log_b(1+{arsinh(e}^{{-Z}_i}))-}\frac{{arsinh(e}^{{-Z}_i})\ {log}_b{(arsinh(e}^{{-Z}_i}))}{1+{arsinh(e}^{{-Z}_i})}]
====Binary Cross-entropy for hyperbolastic H2====
The average binary cross-entropy for hyperbolastic H2 is
:
\begin{align}
\overline{C} & =-\frac{1}{n}\sum_{i=1}^{n}{{[y}_ilog_b(\pi(x_i;\beta))+}{(1-y}_i)log_b(1-\pi(x_i;\beta))] \\
& =\frac{1}{n}\sum_{i=1}^{n}{[log_b(1+{arsinh(e}^{{-Z}_i}))-}{(1-y}_i)log_b({arsinh(e}^{{-Z}_i}))]
\end{align}
=Parameter estimation for the binary hyperbolastic regression of type I and II=
The estimate of the parameter vector can be obtained by maximizing the log-likelihood function
:
where is defined according to one of the two types of hyberbolastic functions used.
=The multinomial hyperbolastic regression of type I and II=
The generalization of the binary hyperbolastic regression to multinomial hyperbolastic regression has a response variable for individual with categories (i.e. ). When , this model reduces to a binary hyperbolastic regression.
For each , we form indicator variables where
:
\begin{cases}
1 & \text{if } y_i = j,\\
0 & \text{if } y_i \neq j
\end{cases}
,
meaning that whenever the response is in category and otherwise.
Define parameter vector in a -dimensional Euclidean space and .
Using category 1 as a reference and as its corresponding probability function, the multinomial hyperbolastic regression of type I probabilities are defined as
:
and for ,
:
Similarly, for the multinomial hyperbolastic regression of type II we have
:
and for ,
:
where with and .
The choice of is dependent on the choice of hyperbolastic H1 or H2.
==Shannon Information for multiclass hyperbolastic H1 or H2==
For the multiclass , the Shannon information is
:.
For a random sample of size , the empirical multiclass information can be estimated by
:.
====Multiclass Entropy in Information Theory====
For a discrete random variable , the multiclass information entropy is defined as
:
where is the probability mass function for the multiclass random variable .
For the hyperbolastic H1 or H2, the multiclass entropy is equal to
:
The estimated average multiclass entropy is equal to
:
====Multiclass Cross-entropy for hyperbolastic H1 or H2====
Multiclass cross-entropy compares the observed multiclass output with the predicted probabilities. For a random sample of multiclass outcomes of size , the average multiclass cross-entropy for hyperbolastic H1 or H2 can be estimated by
:
The log-odds of membership in category versus the reference category 1, denoted by , is equal to
:
where and . The estimated parameter matrix of multinomial hyperbolastic regression is obtained by maximizing the log-likelihood function. The maximum likelihood estimates of the parameter matrix is
: