IRENE (technology)

The technology was developed at Lawrence Berkeley National Laboratory by Carl Haber and Vitaliy Fadeyev and was announced in a publication of the Journal of the Audio Engineering Society in 2003.Vitaliy Fadeyev and Carl Haber, Reconstruction of Mechanically Recorded Sound by Image Processing. Journal of the Audio Engineering Society, 2003. ([https://www-cdf.lbl.gov/~av/JAES-paper-LBNL.pdf PDF]) It grew out of Haber's research in particle physics; in the 1990s, he had worked on Higgs boson detection experiments, and realized that the cameras he was using to set the detectors could also be used for detailed imaging of grooved audio recordings.[https://www.newyorker.com/tech/annals-of-technology/new-sounds-old-voices New Sounds, Old Voices]. The New Yorker, February 26, 2014. The name IRENE is a backronym of the phrase "Image, Reconstruct, Erase Noise, Etc.", and was chosen because the first audio recovered by the system was a recording of the song "Goodnight, Irene" by The Weavers.[https://www.theatlantic.com/technology/archive/2014/06/how-a-machine-in-the-basement-of-the-library-of-congress-is-saving-the-history-of-recorded-sound/372723/ The Machine That's Saving the History of Recorded Sound]. The Atlantic, June 13, 2014. By 2005, Haber and Fadeyev had developed two-dimensional and three-dimensional machines, capable of recovering audio from vertically-cut and laterally-cut grooved media.Fadeyev, Vitaliy; Haber, Carl; Maul, Christian; Mcbride, John W.; Golden, Mitchell. [http://www.aes.org/e-lib/browse.cfm?elib=13423 Reconstruction of Recorded Sound from an Edison Cylinder Using Three-Dimensional Noncontact Optical Surface Metrology]. Journal of the Audio Engineering Society 53 (2005), pp. 485–508. Soon after, Haber and Fadeyev were contacted by the Library of Congress, which began operating its own machine in 2006. In 2013, Haber was awarded a MacArthur Fellowship to continue development of the system.[https://www.newyorker.com/magazine/2014/05/19/a-voice-from-the-past A Voice from the Past]. The New Yorker, May 19, 2014. {{Asof|2020}}, IRENE machines are operated by three institutions – Lawrence Berkeley National Laboratory, the Library of Congress, and the Northeast Document Conservation Center.[https://www.nytimes.com/2015/05/05/science/thomas-edison-talking-dolls-recordings.html Ghostly Voices From Thomas Edison’s Dolls Can Now Be Heard]. New York Times, May 4, 2015.

The IRENE system uses a high-powered confocal microscope that follows the groove path as the disc or cylinder (i.e. phonograph cylinder) rotates underneath it, thereby obtaining detailed images of the audio information.[http://exhibits.lib.berkeley.edu/spotlight/project-irene/feature/the-digitization-process The Digitization Process]. Project IRENE, University of California, Berkeley Libraries. Depending on whether the groove is cut laterally, vertically, or in a V-shape, the system may make use of tracking lasers or different lighting strategies to make the groove visible to the camera. The resulting images are then processed with software that converts the movement of the groove into a digital audio file.[https://www.wired.com/2013/12/dead-media-beat-irene-reviving-and-restoring-lost-sounds/ Dead Media Beat: IRENE, reviving and restoring lost sounds]. Wired, December 26, 2013.

An advantage of the system over traditional stylus playback is that it is contactless, and so avoids damaging the audio carrier or wearing out the groove during playback. It also allows for the reconstruction of already broken or damaged media such as cracked cylinders or delaminating lacquer discs, which cannot be played with a stylus. Media played on machines which are no longer produced can also be recovered.{{cite web|url=https://spectrum.ieee.org/particle-physics-resurrects-alexander-graham-bells-voice |title=Particle Physics Resurrects Alexander Graham Bell's Voice |last=Marsh |first=Allison |publisher=IEEE Spectrum |date=30 April 2018}} Many skips or damaged areas can be reconstituted by IRENE without the noises that would be created by stylus playback.{{cite web|url=https://www.npr.org/templates/story/story.php?storyId=11851842 |title=You Can Play the Record, but Don't Touch |last=Greenfieldboyce |first=Nell |publisher=NPR |date=15 July 2007}} However, it can also result in the reproduction of more noise, as imperfections in the groove are also more finely captured than with a stylus.

{{Listen|filename=Au Clair de la Lune (1860).ogg|title=Au clair de la lune|description= Earliest recognizable recording of human voice, from 9 April 1860, converted into sound by IRENE{{cite web|url=http://www.firstsounds.org/sounds/scott.php|title=FirstSounds.ORG}}{{cite news |first= Jody|last= Rosen|title=Researchers Play Tune Recorded Before Edison. |url=https://www.nytimes.com/2008/03/27/arts/27soun.html?hp |quote=The audio excavation could give a new primacy to the phonautograph, once considered a curio, and its inventor, Édouard-Léon Scott de Martinville, a Parisian typesetter and tinkerer who went to his grave convinced that credit for his breakthroughs had been improperly bestowed on Edison. |work=The New York Times |date= 27 March 2008|access-date=27 March 2008 }}|filename2=1860-Scott-Au-Clair-de-la-Lune-05-09.ogg|title2=Au clair de la lune|description2= The recording slowed down to match what is now believed to be the correct speed; the result reveals a man's voice, presumably Scott's.{{cite web|url=https://www.usnews.com/articles/science/2009/06/01/earliest-known-sound-recordings-revealed.html|title=Earliest Known Sound Recordings Revealed|work=U.S. News & World Report}}}}

The IRENE system has been used to recover audio such as:

• The earliest recovered audio (1860), of Édouard-Léon Scott de Martinville singing "Au clair de la lune"
• Volta Laboratory recordings from the 1880s, including an 1885 recording of Alexander Graham Bell's voice
• A set of cylinders for talking dolls issued by the Edison Company in 1890
• Wax cylinder recordings from 1914–1916, documenting more than 78 Indigenous languages of the Americas, including some that are no longer spoken. They include the only known recordings of Ishi, the last survivor of the Yahi people.{{cite web |url=https://www.facebook.com/US.NSF/videos/rare-audio-recordings-of-indigenous-california-languages-recorded-more-than-100-/10155391870652900/ |title=Rare audio recordings of #indigenous California languages, recorded more than 100 years ago, are now being saved by an #NSFfunded UC |date=8 August 2017 |author=National Science Foundation (NSF)|via=Facebook}} These were collected by anthropologist A.L. Kroeber and linguist Edward Sapir, and are held by the Phoebe A. Hearst Museum of Anthropology"How Edison Got His Groove Back". KQED, July 30, 2008. ([https://www.youtube.com/watch?v=mw9jfX4Ykxw video]) (formerly the anthropology museum of University of California, Berkeley)
• Transcription discs from the Woody Guthrie Foundation
• A transcription disc containing rare recordings of the Stanley Brothers[https://bluegrasstoday.com/rare-stanley-brothers-disc-one-step-closer-to-restoration/ Rare Stanley Brothers disc one step closer to restoration]. Bluegrass Today, July 31, 2018.
• Disc recordings from the Woodberry Poetry Room at Harvard University, of poets (including T.S. Eliot, Marianne Moore, Robert Frost, Muriel Rukeyser, Ezra Pound, and Sylvia Plath) reading their own poems[https://www.wbur.org/news/2014/11/28/irene-audio-preservation-technology At Harvard, Technology Resurrects Long-Silent Voices Of Poets]. WBUR, November 28, 2014.

• Laser turntable
• VisualAudio

{{reflist}}

• Fadeyev, Vitaliy, and Carl Haber. "[https://www.osti.gov/servlets/purl/823748 Reconstruction of mechanically recorded sound by image processing.]" Journal of the Audio Engineering Society 51.12 (2003): 1172-1185.
• McCann, M., P. Calamia, and N. Ailon. "Audio Extraction from Optical Scans of Records." (2004).
• Fadeyev, Vitaliy, et al. "[https://escholarship.org/content/qt6qk9j5sx/qt6qk9j5sx.pdf Reconstruction of mechanically recorded sound from an edison cylinder using three dimensional non-contact optical surface metrology.]" (2004).
• Tian, Baozhong, and John L. Barron. "[https://www.researchgate.net/profile/Das-Arpita/publication/287759869_Object_recognition_using_Artificial_Neural_Network_Case_studies_for_noisy_and_noiseless_images/links/5679231308ae6041cb49eba8/Object-recognition-using-Artificial-Neural-Network-Case-studies-for-noisy-and-noiseless-images.pdf#page=93 Reproduction of sound signal from gramophone records using 3d scene reconstruction.]" Irish Machine Vision and Image Processing Conference. 2006.
• Stotzer, Sylvain. [https://doc.rero.ch/record/7958/files/StotzerS.pdf Phonographic record sound extraction by image processing.] Diss. Université de Fribourg, 2006.
• Cornell, Earl W., et al. "[https://escholarship.org/content/qt0p0450kq/qt0p0450kq.pdf Using optical metrology to reconstruct sound recordings.]" Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment 579.2 (2007): 901-904.
• Li, Beinan, Simon de Leon, and Ichiro Fujinaga. "[https://www.academia.edu/download/35221263/ISMIR2007_p165_li.pdf Alternative Digitization Approach for Stereo Phonograph Records Using Optical Audio Reconstruction.]{{Dead link|date=August 2024 |bot=InternetArchiveBot |fix-attempted=yes }}" ISMIR. 2007.
• Boltryk, P. J., et al. "Noncontact surface metrology for preservation and sound recovery from mechanical sound recordings." Journal of the Audio Engineering Society 56.7/8 (2008): 545-559.
• Aleksandrović, Vesna. "[http://elib.mi.sanu.ac.rs/files/journals/ncd/12/ncd12037.pdf Analog/digital sound. National Library of Serbia digital collection of 78 rpm gramophone records.]" Review of National Center for Digitization 12 (2008): 37-42.
• Li, Beinan, Jordan BL Smith, and Ichiro Fujinaga. "[https://www.academia.edu/download/35221265/PS4-9.pdf Optical Audio Reconstruction for Stereo Phonograph Records Using White Light Interferometry.]{{Dead link|date=August 2024 |bot=InternetArchiveBot |fix-attempted=yes }}" ISMIR. 2009.
• Tian, Baozhong, Samuel Sambasivam, and John Barron. "Practical digital playback of gramophone records using flat-bed scanner images." Audio Engineering Society Convention 131. Audio Engineering Society, 2011.
• Tian, Baozhong, and John L. Barron. "Using computer vision technology to play gramophone records." Journal of the Audio Engineering Society 59.7/8 (2011): 514-538.
• Janukiewicz, Kristofer. "[https://www.diva-portal.org/smash/get/diva2:1056370/FULLTEXT01.pdf A Laser Triangulation Approach for Optical Audio Reconstruction of Phonograph Records.]" (2016).
• Chenot, Jean-Hugues, Louis Laborelli, and Jean-Etienne Noiré. "[https://recherche.ina.fr/content/download/787/3841/version/1/file/JHChenot_Saphir_Digitizing_Broken_Cracked_Delaminated_Lacquer_78rpm_Records_Desktop_Optical_Scanner_JTS2019_v1.00.pdf Saphir: Digitizing broken and cracked or delaminated lacquer 78 rpm records using a desktop optical scanner.]"
• Chenot, Jean-Hugues, Louis Laborelli, and Jean-Étienne Noiré. "[https://hal.science/hal-01885324/file/JHChenot_Saphir_Optical_Playback_Damaged_Analogue_Audio_Discs_JOCCH2018_authors_v1.01.pdf Saphir: optical playback of damaged and delaminated analogue audio disc records.]" Journal on Computing and Cultural Heritage 11.3 (2018): 14-1.
• Hawkins, Julia, and Bryce Roe. "[https://www.nedcc.org/assets/media/documents/JDMM_9_3_JDMM0008_Hawkins_and_Roe.pdf IRENE audio preservation at the Northeast Document Conservation Center: Developing workflows and standards for preservation projects that use innovative technology.]" Journal of Digital Media Management 9.3 (2021): 262-278.
• Chenot, Jean-Hugues, and Jean-Etienne Noiré. "[http://www.aes.org/e-lib/download.cfm/22135.pdf?ID=22135 Challenges in Optical Recovery of Otherwise Unplayable Analogue Audio Disc Records.]" Audio Engineering Society Conference: AES 2023 International Conference on Audio Archiving, Preservation & Restoration. Audio Engineering Society, 2023.
• [https://indico.cern.ch/event/1971/contributions/369313/attachments/289827/405131/VF-Carmel-2006.pdf Using Optical Metrology to Restore Sound Recordings]
• [https://www2.lbl.gov/LBL-Programs/wyp2005/assets/docs/Haber_Summer_Lecture.pdf Using Physics to Restore Early Sound Recordings]
• [https://www-cdf.lbl.gov/~av/LOC-2005-Public.pdf Reconstruct Sound Recordings]
• [https://patentimages.storage.googleapis.com/f9/b0/c3/8a50bebc94faa0/US7345975.pdf United States Patent US7345975 Metrological digital audio reconstruction]

• [http://irene.lbl.gov/ IRENE website], Lawrence Berkeley Laboratories

Category:American inventions

Category:Audio engineering

Category:Conservation and restoration of cultural heritage

Category:Digital preservation

Category:Lawrence Berkeley National Laboratory

Category:Library of Congress