Spectral modeling synthesis
Image:Spectrum Modeling Synthesis overview (based on Curtis Roads 1996, Fig.4.23).jpg
Spectral modeling synthesis (SMS) is an acoustic modeling approach for speech and other signals.
SMS considers sounds as a combination of harmonic content and noise content. Harmonic components are identified based on peaks in the frequency spectrum of the signal, normally as found by the short-time Fourier transform. The signal that remains following removal of the spectral components, sometimes referred to as the residual, is then modeled as white noise passed through a time-varying filter. The output of the model, then, are the frequencies and levels of the detected harmonic components and the coefficients of the time-varying filter.
Intuitively, the model can be applied to many types of audio signals. Speech signals, for example, include slowly changing harmonic sounds caused by vibration of the vocal cords plus wideband, noise-like sounds caused by the lips and mouth. Musical instruments also produce sounds containing both harmonic components and percussive, noise-like sounds when the notes are struck or changed.
{{multiple image |direction=horizontal |align=center
| image1 = SMS analysis (Bonada et al. 2001, Fig.1).svg | width1=288
| image2 = SMS synthesis (Bonada et al. 2001, Fig.2).svg | width2=303
| footer = SMS analysis & synthesis block diagrams (based on {{harvnb|Bonada et al.|2001}}, Fig.1 & Fig.2)
}}
See also
- Speech coding
- CELP
- Source-filter model of speech production
- FM synthesis
- Sound synthesis
- [http://www.klingbeil.com/spear/ SPEAR - Sinusoidal Partial Editing Analysis and Resynthesis]
References
- {{cite web
| title = Spectral Modeling Synthesis: Past and Present
| url = http://www.dtic.upf.edu/~xserra/presentacions/Spectral-Modeling-Synthesis-Past-and-Present.pdf
| accessdate= May 11, 2010
| first = Xavier
| last = Serra
| authorlink= Xavier Serra
| year = 2003
| publisher =
| pages = 20
| language =
| doi =
| archiveurl=
| archivedate=
| quote =
}}
- {{cite web
| title = Spectral Modeling Synthesis Tools
| url = http://mtg.upf.edu/technologies/sms
| accessdate= May 11, 2010
| first = Xavier
| last = Serra
| authorlink= Xavier Serra
| date =
| year =
| publisher =
| pages =
| language =
| doi =
| archiveurl=
| archivedate=
| quote =
}}
- {{cite web
| title = Spectral Modeling
| url = http://ccrma.stanford.edu/~jos/jnmr/Spectral_Modeling.html
| accessdate= April 19, 2008
| first = Julius O.
| last = Smith III
| authorlink= Julius O. Smith III
| date = 28 December 2005
| publisher =
| pages =
| language =
| doi =
| archiveurl=
| archivedate=
| quote =
}}
- {{cite book | last = Roads | first = Curtis
| authorlink= Curtis Roads
| chapter = Figure 4.23: Overview of spectrum modeling synthesis. ...
| title = The Computer Music Tutorial
|url=https://archive.org/details/computermusictut00road
|url-access=limited
| publisher = MIT Press
| date = 1996
| isbn = 978-0-262-68082-0
| page = [https://archive.org/details/computermusictut00road/page/n171 153]
}}
- {{cite journal |ref={{sfnref|Bonada et al.|2001}}
|author1=Bonada, J. |author2=Loscos, A. |author3=Cano, P. |author4-link=Xavier Serra |author4=Serra, X. |author5=Kenmochi, H.
| title = Spectral Approach to the Modeling of the Singing Voice
| work = In Proc. of the 111th AES Convention
| date = 2001
|citeseerx=10.1.1.75.2357 }}
{{DEFAULTSORT:Spectral Modeling Synthesis}}
{{science-software-stub}}