Bluefin Labs

{{multiple issues|

{{Undisclosed paid|date=April 2025}}

{{update|date=October 2023}}

{{promo|date=October 2023}}

}}

{{Short description|Media analyst company}}

{{Infobox company

| name = Bluefin Labs, Inc.

| logo = Bluefin Labs Logo.png

| type = Division

| foundation = 2008

| defunct = 2013

| founder = Michael Fleischman
Deb Roy

| location_city = Cambridge, Massachusetts

| location_country = United States

| services =

| num_employees =

| fate = Acquired by Twitter

| homepage = {{URL|http://www.bluefinlabs.com}}

}}

Bluefin Labs was a Cambridge, MA-based social TV analytics company that used publicly available social media commentary from Twitter, Facebook and blogs to measure viewer engagement with television shows and ads at scale – historically a costly and complex problem for TV and marketing industries to solve.{{cite web|last=Marich|first=Robert|title=Measuring Engagement, Audience Metric Exerts Increasing Influence on Ad Spending, Broadcasting & Cable|url=http://www.broadcastingcable.com/article/101689-COVER_STORY_Measuring_Engagement.php|work=Broadcasting & Cable|publisher=NewBay Media, LLC|accessdate=18 July 2011}}

Bluefin's technology platform, grounded in 15 years of cognitive science and machine learning research at the MIT Media Lab,{{cite journal|last=Roy|first=Deb|title=New Horizons in the Study of Child Language Acquisition|journal=Proceedings of Interspeech|date=September 2009|pages=13–20 |url=http://web.media.mit.edu/~dkroy/papers/pdf/Roy_interspeech_keynote.pdf|accessdate=18 July 2011|publisher=Massachusetts Institute of Technology|location=Brighton, England|doi=10.21437/Interspeech.2009-3 |hdl=1721.1/65900 }} semantically interpreted people's social media comments and automatically linked them with the TV shows and ads they were watching. Bluefin's flagship product offering, Bluefin Signals, was a tool for accessing, interpreting, and analyzing this social TV data.

File:Bluefin Labs - TV Genome Visualization.png

History

File:Bluefin Labs - TV Genome Visualization - 2.png

Bluefin Labs was founded by Deb Roy and Michael Fleischman in 2008.

The seed for the company originated within the MIT Media Lab's Human Speechome Project (HSP). Headed by Roy, head of the Media Lab's Cognitive Machines group, the goal of HSP was to understand language acquisition by making a complete digital record of the first years of a child's home life and analyzing that record computationally. Roy and his wife installed video equipment throughout their home and captured much of their son's life from birth to age three - a total of 240,000 hours of audio and video. Buried in this massive corpus lay insights into how their son learned language at a level of detail never before captured. To sift through the data, Roy and his MIT team developed numerous deep machine learning algorithms designed to uncover the context and patterns within the audio and video data. Their results are explained in [http://www.ted.com/talks/deb_roy_the_birth_of_a_word.html Deb Roy's TEDTalk 'The birth of a word.']

As a student in Roy's MIT group, Fleischman adapted the concepts of data driven designed for language acquisition and applied them to another massive video data set: broadcast video.{{cite journal|last=Fleischman|first=Michael|author2=Roy, Deb|title=Grounded Language Modeling for Automatic Speech Recognition of Sports Video|year=2008|journal=Proceedings of ACL-08: HLT|url=https://www.mit.edu/~mbf/ACL-08.pdf|accessdate=18 July 2011|pages=121–129|publisher=Massachusetts Institute of Technology|location=Columbus, Ohio|url-status=dead|archiveurl=https://web.archive.org/web/20111107005049/http://www.mit.edu/~mbf/ACL-08.pdf|archivedate=7 November 2011}}{{cite journal|last=Fleischman|first=Michael|author2=Roy, Deb|title=Unsupervised Content-Based Indexing of Sports Video|journal=9th ACM Workshop on Multimedia Information Retrieval (MIR)|year=2009|pages=87–94|url=https://www.mit.edu/~mbf/MIR-07.pdf|accessdate=18 July 2011|publisher=MIT Media Laboratory|location=Augsburg, Germany|url-status=dead|archiveurl=https://web.archive.org/web/20111107010823/http://www.mit.edu/~mbf/MIR-07.pdf|archivedate=7 November 2011}} Fleischman's PhD work garnered the attention of the National Science Foundation which awarded Roy and Fleischman a Small Business Innovation Research grant and effectively bootstrapped the launch of Bluefin.

Just as HSP created algorithms that can “ground” the meaning of a word within a larger context,{{cite journal|last=Roy|first=Deb|title=Grounding words in perception and action: computational insights|journal=Trends in Cognitive Sciences|date=August 2005|volume=9|issue=8|pages=389–396|url=http://web.media.mit.edu/~dkroy/papers/pdf/roy_2005_a.pdf|accessdate=18 July 2011|doi=10.1016/j.tics.2005.06.013|pmid=16006171}} Bluefin is using deep machine learning to ground the meaning of a given comment pulled out from a social media stream. By looking at the context of words expressed by individuals, Bluefin can use the meaning of these words to connect comments back to the events, people, places, products, and brands that caused those words to be expressed in the first place.

On July 32, 2012, Bluefin Labs announced that advertising industry veteran JP Maheu will join the company as CEO.{{Cite web|last=|first=|date=26 July 2012|title=Bluefin Labs names former Razorfish, Publicis exec as CEO|url=https://uk.reuters.com/article/idUK377626377720120725|url-status=dead|archive-url=https://web.archive.org/web/20201020231036/https://uk.reuters.com/article/idUK377626377720120725 |archive-date=2020-10-20 |access-date=16 October 2020|website=Reuters}}

On February 6, 2013, Twitter announced that it was buying Bluefin Labs for approximately $100 million.{{cite news|title=Twitter Acquires Bluefin Labs to Add Social TV Tools|newspaper=Bloomberg |date=6 February 2013 |url=https://www.bloomberg.com/news/2013-02-06/twitter-acquires-bluefin-labs-to-add-social-tv-tools.html|publisher=Bloomberg News|accessdate=12 December 2013}}

Technology

Bluefin Labs uses proprietary algorithms to match social media comments to televised content. The methodology of associating comments to TV is composed of three parts: temporal analysis (looking at when a comment is posted), semantic analysis (matching written comments to what's on TV), and machine learning (the ongoing process of training and re-training the matching algorithm). Bluefin also employs a proprietary algorithm for sentiment and gender analysis of the social media comments.

The resulting data set is a large network of cause-effect links that measures people's engagement with TV, effectively creating a viewer/programmer feedback loop. This network is designed to provide marketers and media companies with insights that could be used for more efficient ad targeting and more informed content and creative development.

Bluefin calls this mapping of social media commentary back to its televised stimulus the "TV Genome" – a highly complex endeavor that, like the Human Genome Project, requires immense computational resources along with deep-rooted techniques in cognitive science and machine learning. Bluefin has a view into more than 5 billion public-facing social media comments each month, tied to a continuously growing video fingerprint archive of more than one million distinct airings of TV shows and commercials. Bluefin currently ingests and performs video fingerprinting of 115 U.S. TV broadcast and cable networks.

Products

Bluefin Signals is a social TV analytics suite that measures and organizes the conversations about TV that take place in social media. It is a SaaS analytics platform and is available to Brands, Agencies, and TV Networks on a subscription basis.

Bluefin Signals is being used in various areas of the TV advertising ecosystem, including: research and audience insights, media planning and buying, TV ads sales negotiations, and TV ad creative development and optimization.{{cite web|last=Dumenco|first=Simon|title=How Social TV Helped Save a Fox Sports Marketing Campaign|url=http://adage.com/article/trending-topics/social-tv-helped-save-a-fox-sports-marketing-campaign/233226/|publisher=Advertising Age}}{{cite web|last=Dumenco|first=Simon|title=The 10 Super Bowl Commercials That Blew up the Biggest in Social Media|url=http://adage.com/article/special-report-super-bowl/10-super-bowl-commercials-won-social-media/232548/|publisher=Advertising Age}} Bluefin Signals processes an Electronic Programming Guide (EPG) feed as well as TV closed captioning to ensure accurate telecast-level analytics for social TV conversations.

Bluefin Signals Network Edition is used by over 40 of the top broadcast and cable TV networks in the United States.

Bluefin Signals Brand Edition is the first social TV analytics product built for brands.{{cite web|title=Bluefin Labs Launches First Social TV Analytics Product Built for Brands|url=http://www.businesswire.com/news/home/20120416005498/en/Bluefin-Labs-Launches-Social-TV-Analytics-Product|publisher=Business Wire|date=2012-04-16}}

Board and investors

Early in Bluefin's development, Roy and Fleischman joined with technology entrepreneur Frank Moss (former MIT Media Lab Director, former CEO of Tivoli Systems) and media entrepreneur Brian Bedol (managing partner of Bedrock Venture Partners and founder and former CEO, ESPN Classic and CBS College Sports) to transition the company from research prototypes to a scalable technology platform tuned to the needs of the media industry.

Bluefin Labs received initial Series A funding by Redpoint Ventures, one of the world's top venture capital firms whose investments include: TiVO, Netflix, MySpace, Excite, Juniper, and Right Media.

In January 2012, Bluefin announced it had raised $12 million in a Series B round led by Time Warner Investments with participation from new investor SoftBank Capital and return investors Redpoint Ventures and Lerer Ventures.{{cite web|last=Del Ray|first=Jason|title=Social-TV Startup Bluefin Labs Lands $12 Million Investment|url=http://adage.com/article/digital/social-tv-startup-bluefin-labs-lands-12-million-investment/232296/|publisher=Advertising Age}}

Alongside Redpoint, top executives from the worlds of technology, media, entertainment, and sports have invested in Bluefin. In addition to Bedol, notable angel investors include Jim Pallotta (Raptor Capital Management); co-owner, Boston Celtics), Jonathan Kraft (president, Kraft Group and New England Patriots), Dan Gilbert (founder and chairman, Quicken Loans; majority owner, Cleveland Cavaliers), Kenneth Lerer (Lerer Ventures, co-founder Huffington Post), Jeff Samberg (Acadia Woods), John Fogelman (board member, William Morris Endeavor).

In its transition from pure academic research at the MIT Media Lab to private startup, Bluefin received funding from the National Science Foundation's Small Business Innovation Research (SBIR) grant.

Partnerships and awards

Partnerships

  • In December 2011, Bluefin Labs and Starcom MediaVest Group (SMG) announced a partnership that enables SMG to make more informed media planning and buying decisions for its clients through the use of Bluefin Signals.{{cite web|last=Learmonth|first=Michael|title=With Bluefin Labs, Publicis' SMG Looks Beyond TV Ratings|url=http://adage.com/article/digital/bluefin-labs-publicis-smg-tv-ratings/231649/|publisher=Advertising Age}}
  • In February 2012, Bluefin Labs and ABC News announced a collaboration for coverage of key nights in the 2012 presidential campaign including on-air use of social media insights, analytics and data visualizations during ABC News broadcasts of Super Tuesday, the presidential and vice presidential debates, the Republican and Democratic conventions, Election Night and the inauguration.{{cite web|last=Peterson|first=Tim|title=ABC News, Bluefin Labs Extend Social TV Analytics Partnership Through Presidential Election|date=15 February 2012 |url=http://www.adweek.com/news/technology/abc-news-bluefin-labs-extend-social-tv-analytics-partnership-through-presidential-el|publisher=Ad Week}}

Awards

  • September 2011: Named one of [https://web.archive.org/web/20120815105010/http://fastech.dowjones.com/index.php/speakers#fastech50 VentureWire’s FASTech 50: Most Innovative Start-Ups]
  • September 2011: Named one of The "[http://www.producersguild.org/?page=d25_home Digital 25: Leaders in Emerging Entertainment]" by The Producers Guild of America (PGA), in association with Variety and in partnership with Digital Hollywood.
  • November 2011: Winner of the ad:tech Innovation Award, Social Media category
  • March 2012: Named one of [http://www.technologyreview.com/tr50/2012/ Technology Review’s 50 Most Innovative Technology Companies]

References

{{Reflist}}