ElevenLabs

ElevenLabs was co-founded in 2022 by Piotr Dąbkowski, an ex-Google machine learning engineer and Mati Staniszewski, an ex-Palantir deployment strategist.{{Cite web |last=Kanetkar |first=Riddhi |title=This startup, founded by ex-Google and Palantir staffers, uses AI to generate realistic voiceovers. Here's the 14-slide pitch deck ElevenLabs used to raise $2 million. |url=https://www.businessinsider.com/elevenlabs-ai-voice-intelligence-startup-raises-2-million-2023-1 |access-date=2023-02-09 |website=Business Insider |language=en-US}} Both were raised in Poland, and their inspiration for founding ElevenLabs reportedly came from watching inadequately dubbed American films.{{Cite web |last=Wiggers |first=Kyle |date=2023-06-20 |title=Voice-generating platform ElevenLabs raises $19M, launches detection tool |url=https://techcrunch.com/2023/06/20/voice-generating-platform-elevenlabs-raises-19m-launches-detection-tool/ |access-date=2023-07-25 |website=TechCrunch |language=en-US}}

Dąbkowski and Staniszewski initially considered different funding options, including the possibility of collaborating with a startup accelerator. In January 2023 they revealed having secured a $2 million pre-seed round. The startup's specialization in AI voice intelligence, a still-emerging field in Europe, played a significant role in attracting investors. The pre-seed funding was primarily led by Credo Ventures, and joined by Concept Ventures.{{Cite web |last=Kanetkar |first=Riddhi |title=Hot AI startup ElevenLabs, founded by ex-Google and Palantir staff, is set to raise $18 million at a $100 million valuation. Check out the 14-slide pitch deck it used for its $2 million pre-seed. |url=https://www.businessinsider.com/elevenlabs-ai-voice-intelligence-startup-raises-2-million-2023-1 |access-date=2023-07-25 |website=Business Insider |language=en-US}}

In January 2023, ElevenLabs publicly released its beta platform.{{Cite web |title=A new AI voice tool is already being abused to make deepfake celebrity audio clips |url=https://www.engadget.com/ai-voice-tool-deepfake-celebrity-audio-clips-094648743.html |access-date=2023-02-03 |website=Engadget |language=en-US}}

In June 2023, ElevenLabs raised a $19 million Series A funding round at a valuation of about $100 million,{{Cite news |date=2023-06-21 |title=The trials and tribulations of AI voice tech |work=Financial Times |url=https://www.ft.com/content/a5d2dc13-3139-4cb5-b2bf-233eda013c1b |access-date=2023-07-25}}{{Cite web |last=Hunt |first=Simon |date=2023-06-20 |title=AI firm ElevenLabs achieves $100 million valuation within months of launch |url=https://www.standard.co.uk/business/ai-firm-elevenlabs-achieves-100-million-valuation-after-fresh-funding-round-b1088943.html |access-date=2023-07-25 |website=Evening Standard |language=en}} despite the company having no office and only 15 employees. The funding round was co-led by the venture capital firm Andreessen Horowitz, former GitHub CEO Nat Friedman, and entrepreneur Daniel Gross. It also saw participation from prominent individuals such as SV Angel, Mike Krieger (co-founder of Instagram), Brendan Iribe (co-founder of Oculus), Mustafa Suleyman (co-founder of Deepmind), and Tim O'Reilly (founder of O'Reilly Media). It was also announced that Andreessen Horowitz would be joining ElevenLabs' board.{{Cite web |date=2023-06-20 |title=Now hear this: Voice cloning AI startup ElevenLabs nabs $19M from a16z and other heavy hitters |url=https://venturebeat.com/ai/now-hear-this-voice-cloning-ai-startup-elevenlabs-nabs-19m-from-a16z-and-other-heavy-hitters/ |access-date=2023-07-25 |website=VentureBeat |language=en-US}}

On January 22, 2024, ElevenLabs raised an additional $80 million in Series B funding raising the total valuation of the company to $1.1 billion. The funding round was led by Andreessen Horowitz, Friedman, Gross, and Sequoia Capital. Additionally, the company announced a series of new products, including their Voice Marketplace, AI Dubbing Studio, and mobile app. {{Cite web |date=2024-01-22 |title=ElevenLabs Releases New Voice AI Products and Raises $80M Series B |url=https://elevenlabs.io/blog/series-b/}}

On January 30, 2025, ElevenLabs announced their $180 million Series C funding raising the total valuation of the company to $3.3 billion. The round was co-led by a16z and ICONIQ Growth with additional new investors NEA, World Innovation Lab (WiL), Valor, Endeavor Catalyst Fund and Lunate and brought on strategic investors including Deutsche Telekom, LG Technology Ventures, HubSpot Ventures, NTT DOCOMO Ventures, and RingCentral Ventures. {{Cite web |date=2025-01-30 |title=ElevenLabs triples valuation to $3.3BN, after confirming $180M funding round |url=https://tech.eu/2025/01/30/elevenlabs-triples-valuation-to-3-3bn-after-confirming-180m-funding-round/}}

ElevenLabs is primarily known for its browser-based, AI-assisted text-to-speech software, Speech Synthesis, which can produce lifelike speech by synthesizing vocal emotion and intonation, and now Conversational AI, a developer platform for launching interactive voice agents.{{Cite web |date=January 23, 2023 |title=Generative AI comes for cinema dubbing: Audio AI startup ElevenLabs raises pre-seed |url=https://sifted.eu/articles/generative-ai-audio-elevenlabs/ |access-date=2023-02-03 |website=Sifted |language=en-US}} The company states that its models are trained to interpret the context in the text, and adjust the intonation and pacing accordingly.{{Cite magazine |last=Ashworth |first=Boone |date=April 12, 2023 |title=AI Can Clone Your Favorite Podcast Host's Voice |url=https://www.wired.com/story/ai-podcasts-podcastle-revoice-descript/ |magazine=Wired |language=en-US |access-date=2023-04-25}} It uses advanced algorithms to analyze the contextual aspects of text, aiming to detect emotions like anger, sadness, happiness, or alarm, which enables the system to understand the user's sentiment,{{Cite magazine |author=WIRED Staff |title=This Podcast Is Not Hosted by AI Voice Clones. We Swear |language=en-US |magazine=Wired |url=https://www.wired.com/story/gadget-lab-podcast-594/ |access-date=2023-07-25 |issn=1059-1028}} resulting in achieving a more realistic and human-like inflection. The startup is in the process of patenting this technology. On its beta site, users can submit text and generate audio files from a selection of default voices. Paying users are given the ability to upload custom voice samples to create new vocal styles using the company's voice cloning tool.{{Cite web |last=Frauenfelder |first=Mark |date=January 12, 2023 |title=Software lets you design new synthetic voices from scratch |url=https://boingboing.net/2023/01/12/software-lets-you-design-new-synthetic-voices-from-scratch.html |access-date=2023-02-03 |website=Boing Boing |language=en-US}}

Voice Library is the company's feature for sharing unique voice profiles created using their Voice Design technology. These pre-designed voice profiles allow users to select a voice that best suits their needs, rather than creating one from scratch.{{Cite web |date=January 25, 2023 |title=As Generative AI booms, this British startup secures $2M to imitate human voices — TFN |url=https://techfundingnews.com/as-generative-ai-booms-this-british-startup-secures-2m-to-imitate-human-voices/ |access-date=2023-02-05 |website=Tech Funding News |language=en-US}} There are now more than 1,000 community-created voices in the library. Another tool called VoiceLab allows users to clone voices from just a few short snippets of audio and can create entirely new synthetic voices.

On 20 June 2023, ElevenLabs released an AI recognition tool called the AI Speech Classifier, which it claims is the first of its kind. The tool is accessible through an API and designed to determine if an uploaded audio sample originates from ElevenLabs' proprietary AI technology. The company has expressed its intention to collaborate with other AI developers in creating a universal detection system that could be adopted industry-wide.{{Cite news |last=Thompson |first=Stuart A. |date=2023-03-12 |title=Making Deepfakes Gets Cheaper and Easier Thanks to A.I. |language=en-US |work=The New York Times |url=https://www.nytimes.com/2023/03/12/technology/deepfakes-cheapfakes-videos-ai.html |access-date=2023-07-25 |issn=0362-4331}}

In July 2023, ElevenLabs announced "Projects", a tool for creating long-form spoken content such as audiobooks and dialogue segments with contextually-aware synthetic or custom voices.{{Cite web |last=Bonk |first=Lawrence |title=ElevenLabs' Powerful New AI Tool Lets You Make a Full Audiobook in Minutes |url=https://www.lifewire.com/elevenlabs-new-audiobook-ai-tool-7550061 |access-date=2023-07-25 |website=Lifewire |language=en}} The tool was released in September. In August, ElevenLabs expanded its voice generation capabilities to 28 languages. Using an in-house AI model, it automatically detects languages like Korean, Dutch, and Vietnamese, allowing for "emotionally rich" multilingual speech generation. The company also announced that its technology had officially exited its beta phase.{{Cite web |date=2023-08-22 |title=ElevenLabs' AI Voice Generator Can Now Fake Your Voice in 30 Languages |url=https://gizmodo.com/ai-voice-generator-elevenlabs-fake-voices-30-languages-1850762057 |access-date=2023-09-25 |website=Gizmodo |language=en}}{{Cite web |last=Wiggers |first=Kyle |date=2023-08-22 |title=ElevenLabs' voice-generating tools launch out of beta |url=https://techcrunch.com/2023/08/22/elevenlabs-voice-generating-tools-launch-out-of-beta/ |access-date=2023-09-25 |website=TechCrunch |language=en-US}}

In October 2023, ElevenLabs presented "AI Dubbing," a tool that is able to translate speech into more than 20 languages. The feature is capable of preserving the speaker's original voice, emotions, and intonation, by employing proprietary methods to handle tasks like noise removal, speaker differentiation, transcription, and synchronization of translated speech with the original audio.{{Cite web |last=Sharma |first=Shubham |date=2023-10-10 |title=ElevenLabs introduces AI Dubbing, translating video and audio into 20 languages |url=https://venturebeat.com/ai/elevenlabs-introduces-ai-dubbing-translating-video-and-audio-into-20-languages/ |access-date=2023-11-28 |website=VentureBeat |language=en-US}}

In May 2024, ElevenLabs shared samples from their text-to-music model, though it is not yet available for public use.{{Cite web |last=Morrison |first=Ryan |date=2024-05-10 |title=ElevenLabs is launching a new AI music generator — and you have to hear these clips to appreciate it |url=https://www.tomsguide.com/ai/elevenlabs-is-launching-a-new-ai-music-generator-and-you-have-to-hear-these-clips-to-appreciate-it |access-date=2024-05-14 |website=Tom's Guide |language=en}} In June 2024, ElevenLabs released the ElevenLabs Reader App on iOS and Android which allows users to listen to articles, PDFs, and ePubs with AI Voices on their phone.{{Cite web |date=2024-06-25 |title=ElevenLabs Launches Reader, A Text-to-Audio App |url=https://www.maginative.com/article/elevenlabs-launches-reader-a-text-to-audio-app/ |access-date=2024-07-24 |website=Maginative |language=en}} In July 2024, ElevenLabs released "Voice Isolator" which removes background noise from audio.{{Cite web |last=Sharma |first=Shubham |date=2024-07-04 |title=ElevenLabs launches free AI voice isolator to take on Adobe |url=https://venturebeat.com/ai/elevenlabs-launches-free-ai-voice-isolator-to-take-on-adobe/ |access-date=2024-07-24 |website=VentureBeat |language=en-US}} In November 2024, they released Conversational AI, a developer platform for launching interactive voice agents.{{Cite web |last=Mehta |first=Ivan |date=2024-11-18 |title=ElevenLabs now offers ability to build conversational AI agents |url=https://techcrunch.com/2024/11/18/elevenlabs-now-offers-ability-to-build-conversational-ai-agents/. |access-date=2025-05-18 |website=TechCrunch |language=en-US}} In February 2025, the company introduced a new platform that enables authors to create and publish AI-generated audiobooks directly on its Reader app.{{Cite web |last=Mehta |first=Ivan |date=2025-02-26 |title=ElevenLabs now lets authors create and publish audiobooks on its own platform |url=https://techcrunch.com/2025/02/25/elevenlabs-is-now-letting-authors-create-and-publish-audiobooks-on-its-own-platform/#:~:text=Voice%20AI%20company%20ElevenLabs%20is,Spotify%20for%20AI-narrated%20audiobooks. |access-date=2025-02-26 |website=TechCrunch |language=en-US}} Later that month, the company released Scribe, a speech-to-text model that transcribes audio with character-level timestamps and speaker diarization{{Cite web |last=Schnieder |first=Flavio |date=2025-02-26 |title=Meet Scribe |url=https://elevenlabs.io/blog/meet-scribe |access-date=2025-05-18 |website=ElevenLabs |language=en-US}} with industry-leading word error rate according to internal benchmarks and third party tests from Artificial Analysis. {{Cite web |date=2025-02-26 |title=Speech to Text AI Model & Provider Leaderboard|url=https://artificialanalysis.ai/speech-to-text |access-date=2025-05-18 |website=Artificial Analysis |language=en-US}}

Following its launch in January 2023, ElevenLabs gained rapid momentum and was commended for its voice output quality, fast generation times, and a "generous free tier". It has also been praised for its ability to accurately pronounce names with unique or uncommon pronunciations, addressing a common shortcoming in similar tools that often cater primarily to Western names.{{Cite web |last=Desai |first=Saahil |date=2023-07-17 |title=A Voicebot Just Left Me Speechless |url=https://www.theatlantic.com/technology/archive/2023/07/ai-voice-assistants-name-pronunciation/674731/ |access-date=2023-09-25 |website=The Atlantic |language=en}} The company reached over one million registered users between its launch and June 2023.{{Cite web |title=Your AI Clone Can Fool Family, Your Bank, But Not Your Video Meeting - Tech News Briefing - WSJ Podcasts |url=https://www.wsj.com/podcasts/tech-news-briefing/your-ai-clone-can-fool-family-your-bank-but-not-your-video-meeting/30e43487-627a-4502-857c-06b3624c803f |access-date=2023-07-25 |website=WSJ |language=en}}

ElevenLabs was criticized after users were able to abuse its software to generate controversial statements in the vocal style of celebrities, public officials, and other famous individuals,{{Cite news |last=Jimenez |first=Jorge |date=January 31, 2023 |title=AI company promises changes after 'voice cloning' tool used to make celebrities say awful things |language=en |work=PC Gamer |url=https://www.pcgamer.com/ai-company-promises-changes-after-voice-cloning-tool-used-to-make-celebrities-say-awful-things/ |access-date=2023-02-03}}{{Cite web |date=2023-01-31 |title=People Are Still Terrible: AI Voice-Cloning Tool Misused for Deepfake Celeb Clips |url=https://me.pcmag.com/en/news/14327/people-are-still-terrible-ai-voice-cloning-tool-misused-for-deepfake-celeb-clips |access-date=2023-07-25 |website=PCMag Middle East |language=en-ae}}{{Cite web |date=February 2, 2023 |title=Internet Up in Arms as 4Chan User Uses AI Voice Simulator To Deepfake Emma Watson's Voice, Makes Her Read Hitler's Autobiography – FandomWire |url=https://fandomwire.com/internet-up-in-arms-as-4chan-user-uses-ai-voice-simulator-to-deepfake-emma-watsons-voice-makes-her-read-hitlers-autobiography/ |access-date=2023-02-03 |website=fandomwire.com |language=en-US}}{{Cite web |title=The generative A.I. software race has begun |url=https://fortune.com/2023/01/31/generative-a-i-is-about-to-upend-enterprise-software-and-cybersecurity/ |access-date=2023-02-03 |website=Fortune |language=en}}{{Cite news |last1=Milmo |first1=Dan |last2=Hern |first2=Alex |date=2023-05-20 |title=Elections in UK and US at risk from AI-driven disinformation, say experts |language=en-GB |work=The Guardian |url=https://www.theguardian.com/technology/2023/may/20/elections-in-uk-and-us-at-risk-from-ai-driven-disinformation-say-experts |access-date=2023-07-25 |issn=0261-3077}} particularly attracting attention after users on 4chan used the tool to share hateful messages.{{Cite web |last=Vincent |first=James |date=January 31, 2023 |title=4chan users embrace AI voice clone tool to generate celebrity hatespeech |url=https://www.theverge.com/2023/1/31/23579289/ai-voice-clone-deepfake-abuse-4chan-elevenlabs |access-date=2023-02-03 |website=The Verge |language=en-US}} The software's ability to closely replicate real voices has raised ethical concerns, with critics likening it to deepfaking.{{Cite web |title=Seeing is believing? Global scramble to tackle deepfakes |url=https://news.yahoo.com/seeing-believing-global-scramble-tackle-013429757.html |access-date=2023-02-03 |website=news.yahoo.com |language=en-US}} In response, the company said it would work on mitigating potential abuse through safeguards and identity verification. The company has subsequently limited access to its voice cloning feature to paid subscribers,{{Cite tweet|number=1620443097057607681|user=elevenlabsio|title=Thank you everyone for your advice. We love what you're creating, but a set of actors use our tech for malicious purposes. We decided to take the following steps to address the issues|date=January 31, 2023|access-date=2023-04-25}} citing the requirement to provide payment information as means for improving accountability,{{Cite tweet|number=1620443309675249664|user=elevenlabsio|title=This will keep our tools accessible while allowing us to fight potential misuse. Payment details won't always prevent abuse, but they make VoiceLab users less anonymous and force them to think twice before sharing improper content.|date=January 31, 2023|access-date=2023-04-25}} and has implemented bans on users who repeatedly violate the terms of service.

In the leadup to the January 2024 New Hampshire democratic primary, AI-generated robocalls purportedly from Joe Biden encouraging voters to skip voting on the day of the primary were sent to thousands of residents. The New Hampshire attorney general's office launched an investigation into the incident and linked it to a company based in Texas, with audio experts concluding the call was made using ElevenLabs. In response to the incident, CEO Mati Staniszewski stated that the company was “dedicated to preventing the misuse of audio AI tools” but provided no comment on specific incidents.{{Cite magazine |last=Knibbs |first=Kate |title=Researchers Say the Deepfake Biden Robocall Was Likely Made With Tools From AI Startup ElevenLabs |url=https://www.wired.com/story/biden-robocall-deepfake-elevenlabs/ |access-date=2024-02-15 |magazine=Wired |language=en-US |issn=1059-1028}}

Additional concerns have been raised over the ethics of the source of ElevenLabs' training data, with multiple voice actors claiming ElevenLabs used samples of their voices without their consent.{{Cite web |date=2023-02-13 |title=Your Favorite Voice Actors Call Out AI Sites Copying Voices Without Consent |url=https://kotaku.com/ai-voice-actors-steve-blum-elevenlabs-contracts-sell-1850108292 |access-date=2023-12-10 |website=Kotaku |language=en}} ElevenLabs, along with other companies in its category, has thus been seen as a potential challenge to the voice acting sector.

• 15.ai
• Respeecher
• Speechify

• {{Official website}}

{{Speech synthesis}}

{{Generative AI}}

{{Artificial intelligence navbox}}

Category:2022 establishments in New York City

Category:American companies established in 2022

Category:Artificial intelligence companies

Category:Artificial intelligence laboratories

Category:Software companies based in New York City

Category:Software companies established in 2022

Category:Software companies of the United States

Category:Speech synthesis