Google Assistant

{{Short description|AI-powered digital assistant from Google}}

{{Use mdy dates|date=January 2022}}

{{Infobox software

| name = Google Assistant

| logo = Google Assistant logo.svg

| screenshot = Google Assistant Pixel.png

| logo_size = 100px

| screenshot_size = 225px

| caption = Google Assistant on the Pixel smartphone

| developer = Google

| released = {{start date and age|2016|5|18}}

| discontinued =

| programming language = C++

| operating system = Android, ChromeOS, iOS, iPadOS, KaiOS, Linux, Android TV, Wear OS

| platform = {{plainlist|

}}

| replaces = Google Now

| replaced_by = Google Gemini

| language = English, Arabic, Bengali, Chilean Spanish, Colombian Spanish, Chinese (Simplified), Chinese (Traditional), Danish, Dutch, French, German, Gujarati, Hindi, Indonesian, Italian, Japanese, Kannada, Korean, Malayalam, Marathi, Norwegian, Polish, Portuguese, Russian, Spanish, Swedish, Tamil, Telugu, Thai, Turkish, Urdu, Vietnamese

| genre = Virtual assistant

| website = {{URL|https://assistant.google.com/}}

}}

Google Assistant is a virtual assistant software application developed by Google that is primarily available on home automation and mobile devices. Based on artificial intelligence, Google Assistant can engage in two-way conversations,[https://www.cultofmac.com/447898/google-home-google-assistant-siri-ai/ The future is AI, and Google just showed Apple how it's done] {{Webarchive|url=https://web.archive.org/web/20201108162911/https://www.cultofmac.com/447898/google-home-google-assistant-siri-ai/ |date=November 8, 2020 }} Published October 5, 2016, Retrieved July 5, 2018 unlike the company's previous virtual assistant, Google Now.

Google Assistant debuted in 2016 as part of Google's messaging app Allo, and its voice-activated speaker Google Nest. After a period of exclusivity on the Google Pixel smartphones, it was deployed on other Android devices starting in February 2017, including third-party smartphones and Android Wear (now Wear OS), and was released as a standalone app on the iOS operating system in May 2017. Alongside the announcement of a software development kit in April 2017, Assistant has been further extended to support a large variety of devices, including cars and third-party smart home appliances. The functionality of Assistant can also be enhanced by third-party developers. At CES 2018, the first Assistant-powered smart displays (Smart speakers with video screens) were announced, with the first one being released in July 2018.{{Cite news|url=https://www.theverge.com/2018/1/8/16860142/new-google-assistant-speakers-screens-lenovo-jbl-lg-ces-2018|title=Google is introducing a new Smart Display platform|last=Bohn|first=Dieter|date=January 8, 2018|work=The Verge|access-date=January 13, 2018|publisher=Vox Media|archive-date=November 9, 2020|archive-url=https://web.archive.org/web/20201109040838/https://www.theverge.com/2018/1/8/16860142/new-google-assistant-speakers-screens-lenovo-jbl-lg-ces-2018|url-status=live}} In 2020, Google Assistant is already available on more than 1 billion devices.{{Cite web|url=https://blog.google/products/assistant/ces-2020-google-assistant/|title=Google Assistant is already available on more than 1 billion devices.|date=January 7, 2020|language=en-US|access-date=January 7, 2020|archive-date=November 27, 2020|archive-url=https://web.archive.org/web/20201127165358/https://www.blog.google/products/assistant/ces-2020-google-assistant/|url-status=live}}

Users primarily interact with Google Assistant through natural voice, though keyboard input is also supported. Assistant is able to answer questions, schedule events and alarms, adjust hardware settings on the user's device, show information from the user's Google account, play games, and more. Google has also announced that Assistant will be able to identify objects and gather visual information through the device's camera, and support purchasing products as well as sending money. Google Assistant is available in more than 90 countries and over 30 languages,Ben, Hannes, [https://locaria.com/the-future-of-voice-commerce-and-localisation/ "The Future of Voice Commerce and Localisation"] {{Webarchive|url=https://web.archive.org/web/20201020144924/https://locaria.com/the-future-of-voice-commerce-and-localisation/ |date=October 20, 2020 }}, Locaria, February 20, 2020 and is used by more than 500 million users monthly.{{Cite web|url=https://blog.google/products/assistant/ces-2020-google-assistant/|title=A more helpful Google Assistant for your every day|date=January 7, 2020|website=Google|language=en|access-date=January 21, 2020|archive-date=November 27, 2020|archive-url=https://web.archive.org/web/20201127165358/https://www.blog.google/products/assistant/ces-2020-google-assistant/|url-status=live}}

In October 2023, a mobile version of the Gemini chatbot, originally titled Assistant with Bard and simply just Bard, was unveiled during the Pixel 8 event. It is set to replace Assistant as the main assistant on Android devices, although the original Assistant will remain optional. The chatbot was released on February 8, 2024, in the United States.{{Cite web |title=Google Assistant is having a Windows Copilot moment, and it's all thanks to AI |url=https://www.zdnet.com/article/google-assistant-is-have-a-windows-copilot-moment-and-its-all-thanks-to-ai/ |access-date=2023-11-24 |website=ZDNET |language=en}}{{Cite web |last=Vonau |first=Manuel |date=2023-11-23 |title=Google to let you use 'Classic Assistant' without Bard in the future |url=https://www.androidpolice.com/google-use-classic-assistant-without-bard-future/ |access-date=2023-11-24 |website=Android Police |language=en}}{{Cite web |last=Li |first=Abner |date=2024-01-16 |title=Google might rebrand 'Assistant with Bard' before launch |url=https://9to5google.com/2024/01/16/google-assistant-bard-rebrand/ |access-date=2024-01-17 |website=9to5Google |language=en-US}}{{Cite web |last=Li |first=Abner |date=2024-02-08 |title=Gemini app brings Google AI to Android and iPhone, rolling out now |url=https://9to5google.com/2024/02/08/google-gemini-app-android-iphone/ |access-date=2024-02-08 |website=9to5Google |language=en-US}}

On March 14, 2025, it was announced that Assistant would stop working on Android devices using Android 10 and higher, iOS and other devices such as the Google Nest, being mostly replaced by Gemini. Assistant would remain for low-range phones or phones running Android 9 "Pie" and lower.{{Cite web |last=Peters |first=Jay |date=2025-03-14 |title=Google is officially dumping Assistant for Gemini |url=https://www.theverge.com/news/629904/google-assistant-gemini-moving-on |access-date=2025-03-14 |website=The Verge |language=en-US}}

History

The Google Assistant was unveiled during Google's developer conference on May 18, 2016, as part of the unveiling of the Google Nest smart speaker and new messaging app Allo; Google CEO Sundar Pichai explained that the Assistant was designed to be a conversational and two-way experience, and "an ambient experience that extends across devices".{{Cite web |first=Matthew |last=Lynley |title=Google unveils Google Assistant, a virtual assistant that's a big upgrade to Google Now |url=https://techcrunch.com/2016/05/18/google-unveils-google-assistant-a-big-upgrade-to-google-now/ |website=TechCrunch |publisher=AOL |date=May 18, 2016 |access-date=March 17, 2017 |archive-date=January 26, 2021 |archive-url=https://web.archive.org/web/20210126003811/https://techcrunch.com/2016/05/18/google-unveils-google-assistant-a-big-upgrade-to-google-now/ |url-status=live }} Later that month, Google assigned Google Doodle leader Ryan Germick and hired former Pixar animator Emma Coats to develop "a little more of a personality".{{Cite web |first=Christian |last=de Looper |title=Google wants to make its next personal assistant more personable by giving it a childhood |url=http://www.digitaltrends.com/mobile/google-assistant-getting-childhood/ |website=Digital Trends |date=May 31, 2016 |access-date=March 17, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110040336/https://www.digitaltrends.com/mobile/google-assistant-getting-childhood/ |url-status=live }}

= Platform expansion =

File:Google Assistant.ogg

For system-level integration outside of the Allo app and Google Nest, the Google Assistant was initially exclusive to the Google Pixel smartphones.{{Cite web |first=Vlad |last=Savov |title=Pixel 'phone by Google' announced |url=https://www.theverge.com/2016/10/4/13161028/google-phone-announced-pixel-xl-price-release-date-specs |website=The Verge |publisher=Vox Media |date=October 4, 2016 |access-date=March 17, 2017 |archive-date=February 10, 2017 |archive-url=https://web.archive.org/web/20170210094337/http://www.theverge.com/2016/10/4/13161028/google-phone-announced-pixel-xl-price-release-date-specs |url-status=live }} In February 2017, Google announced that it had begun to enable access to the Assistant on Android smartphones running Android 6.0.1 or 7.0, beginning in select English-speaking markets.{{Cite web |first=Dieter |last=Bohn |title=The Google Assistant is coming to Marshmallow and Nougat Android phones starting this week |url=https://www.theverge.com/2017/2/26/14728594/google-assistant-android-phones-marshmallow-nougat-rollout |website=The Verge |publisher=Vox Media |date=February 26, 2017 |access-date=March 17, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033253/https://www.theverge.com/2017/2/26/14728594/google-assistant-android-phones-marshmallow-nougat-rollout |url-status=live }}{{Cite web |first=Ingrid |last=Lunden |title=Google Assistant, its AI-based personal helper, rolls out to Nougat and Marshmallow handsets |url=https://techcrunch.com/2017/02/26/google-assistant-its-ai-based-personal-helper-rolls-out-to-nougat-and-marshmallow-handsets/ |website=TechCrunch |publisher=AOL |date=February 26, 2017 |access-date=March 17, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033303/https://techcrunch.com/2017/02/26/google-assistant-its-ai-based-personal-helper-rolls-out-to-nougat-and-marshmallow-handsets/ |url-status=live }} Android tablets did not receive the Assistant as part of this rollout.{{Cite web |first=Rita |last=El Khoury |title=Google confirms wider Assistant rollout will not reach tablets |url=http://www.androidpolice.com/2017/03/16/google-confirms-us-wider-assistant-rollout-will-not-reach-tablets/ |website=Android Police |date=March 16, 2017 |access-date=March 17, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033309/https://www.androidpolice.com/2017/03/16/google-confirms-us-wider-assistant-rollout-will-not-reach-tablets/ |url-status=live }}{{Cite web |first=Jacob |last=Kastrenakes |title=Android tablets aren't getting Google Assistant anytime soon |url=https://www.theverge.com/2017/3/16/14945500/android-tablets-google-assistant-no-rollout-yet |website=The Verge |publisher=Vox Media |date=March 16, 2017 |access-date=March 17, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033234/https://www.theverge.com/2017/3/16/14945500/android-tablets-google-assistant-no-rollout-yet |url-status=live }} The Assistant is also integrated in Wear OS 2.0,{{Cite web |first=Ron |last=Amadeo |title=Report: Android Wear 2.0 to launch February 9 |url=https://arstechnica.com/gadgets/2017/01/report-android-wear-2-0-to-launch-february-9th/ |website=Ars Technica |publisher=Condé Nast |date=January 17, 2017 |access-date=March 17, 2017 |archive-date=December 1, 2020 |archive-url=https://web.archive.org/web/20201201002447/https://arstechnica.com/gadgets/2017/01/report-android-wear-2-0-to-launch-february-9th/ |url-status=live }} and will be included in future versions of Android TV{{Cite web |first=Nathan |last=Ingraham |title=The Google Assistant is coming to Android TV |url=https://www.engadget.com/2017/01/04/google-assistant-android-tv/ |website=Engadget |publisher=AOL |date=January 4, 2017 |access-date=March 17, 2017 |archive-date=March 7, 2020 |archive-url=https://web.archive.org/web/20200307214800/https://www.engadget.com/2017/01/04/google-assistant-android-tv/ |url-status=live }}{{Cite web |first=Micah |last=Singleton |title=Google Assistant is coming to Android TV later this year |url=https://www.theverge.com/2017/5/17/15648978/google-android-tv-update-assistant-io-2017 |website=The Verge |publisher=Vox Media |date=May 17, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033344/https://www.theverge.com/2017/5/17/15648978/google-android-tv-update-assistant-io-2017 |url-status=live }} and Android Auto.{{Cite web |first=Ron |last=Amadeo |title=Google Assistant comes to every Android phone, 6.0 and up |url=https://arstechnica.com/gadgets/2017/02/google-assistant-comes-to-every-android-phone-6-0-and-up/ |website=Ars Technica |publisher=Condé Nast |date=February 26, 2017 |access-date=March 17, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033253/https://arstechnica.com/gadgets/2017/02/google-assistant-comes-to-every-android-phone-6-0-and-up/ |url-status=live }} In October 2017, the Google Pixelbook became the first laptop to include Google Assistant.{{Cite news|url=https://www.telegraph.co.uk/technology/2017/10/04/google-launches-pixelbook-first-laptop-google-assistant/ |archive-url=https://ghostarchive.org/archive/20220112/https://www.telegraph.co.uk/technology/2017/10/04/google-launches-pixelbook-first-laptop-google-assistant/ |archive-date=January 12, 2022 |url-access=subscription |url-status=live|title=Google launches Pixelbook as first laptop with Google Assistant|last=Field|first=Matthew|date=October 4, 2017|work=The Daily Telegraph|access-date=December 15, 2017}}{{cbignore}} Google Assistant later came to the Google Pixel Buds.{{Cite web |first=Khari |last=Johnson |title=Google Pixel Buds review: Google Assistant makes a home in your ears |url=https://venturebeat.com/2017/11/11/google-pixel-buds-review-google-assistant-makes-a-home-in-your-ears/ |website=VentureBeat |date=November 11, 2017 |access-date=December 10, 2017 |archive-date=November 9, 2020 |archive-url=https://web.archive.org/web/20201109025641/https://venturebeat.com/2017/11/11/google-pixel-buds-review-google-assistant-makes-a-home-in-your-ears/ |url-status=live }} In December 2017, Google announced that the Assistant would be released for phones running Android 5.0 through an update to Google Play Services, as well as tablets running 6.0 Marshmallow and 7.0 Nougat.{{Cite web |first=Frederic |last=Lardinois |title=Google Assistant is coming to older Android phones and tablets |url=https://techcrunch.com/2017/12/13/google-assistant-is-coming-to-older-android-phones-and-tablets/ |website=TechCrunch |publisher=Oath Inc. |date=December 13, 2017 |access-date=December 13, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110040329/https://techcrunch.com/2017/12/13/google-assistant-is-coming-to-older-android-phones-and-tablets/ |url-status=live }} In February 2019, Google reportedly began testing ads in Google Assistant results.{{Cite web|url=https://searchengineland.com/google-takes-baby-steps-to-monetize-google-assistant-google-home-315743|title=Google takes baby steps to monetize Google Assistant, Google Home|last=Sterling|first=Greg|date=April 22, 2019|publisher=Search Engine Land|access-date=April 22, 2019|archive-date=December 1, 2020|archive-url=https://web.archive.org/web/20201201062531/https://searchengineland.com/google-takes-baby-steps-to-monetize-google-assistant-google-home-315743|url-status=live}}

On May 15, 2017, Android Police reported that the Google Assistant would be coming to the iOS operating system as a separate app.{{Cite web |first=David |last=Ruddock |title=Google will announce Assistant for iOS soon, in the US only at launch |url=http://www.androidpolice.com/2017/05/15/google-will-announce-assistant-for-ios-soon-in-the-us-only-at-launch/ |website=Android Police |date=May 15, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033403/https://www.androidpolice.com/2017/05/15/google-will-announce-assistant-for-ios-soon-in-the-us-only-at-launch/ |url-status=live }} The information was confirmed two days later at Google's developer conference.{{Cite web |first=Natt |last=Garun |title=Hey Siri, Google Assistant is on the iPhone now |url=https://www.theverge.com/2017/5/17/15648020/google-assistant-iphone-app-announced-release-date-io-2017 |website=The Verge |publisher=Vox Media |date=May 17, 2017 |access-date=May 17, 2017 |archive-date=November 11, 2020 |archive-url=https://web.archive.org/web/20201111220955/https://www.theverge.com/2017/5/17/15648020/google-assistant-iphone-app-announced-release-date-io-2017 |url-status=live }}{{Cite web |first=Romain |last=Dillet |title=Google launches Google Assistant on the iPhone |url=https://techcrunch.com/2017/05/17/google-launches-google-assistant-on-the-iphone/ |website=TechCrunch |publisher=AOL |date=May 17, 2017 |access-date=May 17, 2017 |archive-date=September 29, 2020 |archive-url=https://web.archive.org/web/20200929080745/https://techcrunch.com/2017/05/17/google-launches-google-assistant-on-the-iphone/ |url-status=live }}

== Smart displays ==

In January 2018 at the Consumer Electronics Show, the first Assistant-powered "smart displays" were released.{{Cite news|url=https://www.usatoday.com/story/tech/news/2018/01/09/ces-2018-google-smart-displays-show-and-tell-answers-echo-show/1014846001/|title=Google Assistant is coming to smart screens, rivaling Amazon Echo Show|last=Baig|first=Edward|date=January 9, 2018|work=USA Today|access-date=January 13, 2018|via=WBIR-TV}} Smart displays were shown at the event from Lenovo, Sony, JBL and LG.{{Cite news|url=https://www.engadget.com/2018/01/12/smart-display-android-things-google-assistant-ces/|title=CES showed us smart displays will be the new normal|last=Lee|first=Nicole|date=January 12, 2018|work=Engadget|access-date=January 13, 2018|publisher=January 13, 2018|archive-date=January 15, 2020|archive-url=https://web.archive.org/web/20200115084603/https://www.engadget.com/2018/01/12/smart-display-android-things-google-assistant-ces/|url-status=live}} These devices have support for Google Duo video calls, YouTube videos, GMaps directions, a GCalendar agenda, viewing of smart camera footage, in addition to services which work with Google Home devices.

These devices are based on Android Things and Google-developed software. Google unveiled its own smart display, Google Nest Hub in October 2018, and later Google Nest Hub Max, which utilizes a different system platform.{{Cite news|url=https://arstechnica.com/gadgets/2018/10/google-home-hub-under-the-hood-its-nothing-like-other-google-smart-displays/|title=Google Home Hub—Under the hood, it's nothing like other Google smart displays|work=Ars Technica|access-date=October 11, 2018|language=en-us|archive-date=December 4, 2020|archive-url=https://web.archive.org/web/20201204063211/https://arstechnica.com/gadgets/2018/10/google-home-hub-under-the-hood-its-nothing-like-other-google-smart-displays/|url-status=live}}

= Developer support =

In December 2016, Google launched "Actions on Google", a developer platform for the Google Assistant. Actions on Google allows 3rd party developers to build apps for Google Assistant.{{Cite web |first=Paul |last=Miller |title=Google Assistant will open up to developers in December with 'Actions on Google' |url=https://www.theverge.com/2016/10/4/13164882/google-assistant-actions-on-google-developer-sdk |website=The Verge |publisher=Vox Media |date=October 4, 2016 |access-date=May 8, 2017 |archive-date=May 16, 2020 |archive-url=https://web.archive.org/web/20200516015739/https://www.theverge.com/2016/10/4/13164882/google-assistant-actions-on-google-developer-sdk |url-status=live }}{{Cite web |first=Cherlynn |last=Low |title=Google opens up its Assistant actions to developers |url=https://www.engadget.com/2016/12/08/google-opens-up-its-assistant-actions-to-developers/ |website=Engadget |publisher=AOL |date=December 8, 2016 |access-date=May 8, 2017 |archive-date=December 10, 2019 |archive-url=https://web.archive.org/web/20191210132906/https://www.engadget.com/2016/12/08/google-opens-up-its-assistant-actions-to-developers/ |url-status=live }} In March 2017, Google added new tools for developing on Actions on Google to support the creation of games for Google Assistant.{{Cite web |first=Sunil |last=Vemuri |title=Game developers rejoice—new tools for developing on Actions on Google |url=https://developers.googleblog.com/2017/03/game-developers-rejoicenew-tools-for.html |website=Google Developers Blog |date=March 30, 2017 |access-date=May 8, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110040336/https://developers.googleblog.com/2017/03/game-developers-rejoicenew-tools-for.html |url-status=live }} Originally limited to the Google Nest smart speaker, Actions on Google was made available to Android and iOS devices in May 2017,{{Cite web |first=Dieter |last=Bohn |title=Third-party actions will soon work on Google Assistant on the phone |url=https://www.theverge.com/2017/5/17/15648538/google-actions-android-ios-phones-third-party-app-assistant-io-2017 |website=The Verge |publisher=Vox Media |date=May 17, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033500/https://www.theverge.com/2017/5/17/15648538/google-actions-android-ios-phones-third-party-app-assistant-io-2017 |url-status=live }}{{Cite web |first=Sarah |last=Perez |title=Google Actions expand to Android and iPhone |url=https://techcrunch.com/2017/05/17/google-actions-expand-to-android-and-iphone/ |website=TechCrunch |publisher=AOL |date=May 17, 2017 |access-date=May 30, 2017 |archive-date=December 1, 2018 |archive-url=https://web.archive.org/web/20181201222356/https://techcrunch.com/2017/05/17/google-actions-expand-to-android-and-iphone/ |url-status=live }} at which time Google also introduced an app directory or application directory for overview of compatible products and services.{{Cite web |first=Ryan |last=Whitwam |title=Google Assistant gets an app directory with categories and sample commands |url=http://www.androidpolice.com/2017/05/18/google-assistant-gets-app-directory-categories-sample-commands/ |website=Android Police |date=May 18, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033435/https://www.androidpolice.com/2017/05/18/google-assistant-gets-app-directory-categories-sample-commands/ |url-status=live }} To incentivize developers to build Actions, Google announced a competition, in which first place won tickets to Google's 2018 developer conference, $10,000, and a walk-through of Google's campus, while second place and third place received $7,500 and $5,000, respectively, and a Google Home.{{Cite web |first=Corbin |last=Davenport |title=Google is offering up to $10,000 to developers making Google Assistant actions |url=http://www.androidpolice.com/2017/05/29/google-offering-prizes-developers-making-google-assistant-actions/ |website=Android Police |date=May 29, 2017 |access-date=June 1, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033535/https://www.androidpolice.com/2017/05/29/google-offering-prizes-developers-making-google-assistant-actions/ |url-status=live }}

In April 2017, a software development kit (SDK) was released, allowing third-party developers to build their own hardware that can run the Google Assistant.{{Cite web |first=Ron |last=Amadeo |title=The Google Assistant SDK will let you run the Assistant on anything |url=https://arstechnica.com/gadgets/2017/04/the-google-assistant-opens-up-to-third-party-hardware-launches-sdk/ |website=Ars Technica |publisher=Condé Nast |date=April 27, 2017 |access-date=April 28, 2017 |archive-date=November 11, 2020 |archive-url=https://web.archive.org/web/20201111212515/https://arstechnica.com/gadgets/2017/04/the-google-assistant-opens-up-to-third-party-hardware-launches-sdk/ |url-status=live }}{{Cite web |first=Dieter |last=Bohn |title=Anybody can make a Google Assistant gadget with this new toolkit |url=https://www.theverge.com/2017/4/27/15442994/google-assistant-sdk-smart-speaker-actions-gadgets-raspberry-pi |website=The Verge |publisher=Vox Media |date=April 27, 2017 |access-date=April 28, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033612/https://www.theverge.com/2017/4/27/15442994/google-assistant-sdk-smart-speaker-actions-gadgets-raspberry-pi |url-status=live }} It has been integrated into Raspberry Pi,{{Cite web |first=Scott Adam |last=Gordon |title=Google voice control comes to the Raspberry Pi via new DIY kit |url=http://www.androidauthority.com/raspberry-pi-google-voice-control-769527/ |website=Android Authority |date=May 4, 2017 |access-date=May 8, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033452/https://www.androidauthority.com/raspberry-pi-google-voice-control-769527/ |url-status=live }}{{Cite web |first=James |last=Vincent |title=You can now use Google's AI to add voice commands to your Raspberry Pi |url=https://www.theverge.com/circuitbreaker/2017/5/4/15541136/google-assistant-raspberry-pi-sdk-voice-hat |website=The Verge |publisher=Vox Media |date=May 4, 2017 |access-date=May 8, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033537/https://www.theverge.com/circuitbreaker/2017/5/4/15541136/google-assistant-raspberry-pi-sdk-voice-hat |url-status=live }} cars from Audi and Volvo,{{Cite web |first1=Mark |last1=Gurman |first2=Mark |last2=Bergen |title=Google Wants Android and Its Assistant to Power Your Car Too |url=https://www.bloomberg.com/news/articles/2017-05-15/google-wants-android-and-its-assistant-to-power-your-car-too |website=Bloomberg Technology |publisher=Bloomberg L.P. |date=May 15, 2017 |access-date=May 17, 2017 |archive-date=November 14, 2020 |archive-url=https://web.archive.org/web/20201114090842/https://www.bloomberg.com/news/articles/2017-05-15/google-wants-android-and-its-assistant-to-power-your-car-too |url-status=live }}{{Cite web |first=Sean |last=O'Kane |title=Audi and Volvo will use Android as the operating system in upcoming cars |url=https://www.theverge.com/2017/5/15/15640596/google-android-auto-audi-volvo-apple-carplay-io-2017 |website=The Verge |publisher=Vox Media |date=May 15, 2017 |access-date=May 17, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033611/https://www.theverge.com/2017/5/15/15640596/google-android-auto-audi-volvo-apple-carplay-io-2017 |url-status=live }} and Home automation appliances, including fridges, washers, and ovens, from companies including iRobot, LG, General Electric, and D-Link.{{Cite web |first=Rita |last=El Khoury |title=Google Assistant can now control more appliances and smart home devices including Roomba, LG, GE, and D-Link |url=http://www.androidpolice.com/2017/05/18/google-assistant-can-now-control-appliances-smart-home-devices-including-roomba-lg-ge-d-link/ |website=Android Police |date=May 18, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033522/https://www.androidpolice.com/2017/05/18/google-assistant-can-now-control-appliances-smart-home-devices-including-roomba-lg-ge-d-link/ |url-status=live }}{{Cite web |first=Jacob |last=Kastrenakes |title=LG and GE add Google Assistant support to fridges, washers, ovens, and more |url=https://www.theverge.com/2017/5/17/15655262/lg-ge-google-assistant-support-appliances-io-2017 |website=The Verge |publisher=Vox Media |date=May 17, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033516/https://www.theverge.com/2017/5/17/15655262/lg-ge-google-assistant-support-appliances-io-2017 |url-status=live }}{{Cite web |first=Megan |last=Wollerton |title=Google Assistant makes its way to your large home appliances |url=https://www.cnet.com/news/google-assistant-makes-its-way-to-your-large-home-appliances-google-home/ |website=CNET |publisher=CBS Interactive |date=May 17, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033522/https://www.cnet.com/news/google-assistant-makes-its-way-to-your-large-home-appliances-google-home/ |url-status=live }} Google updated the SDK in December 2017 to add several features that only the Google Home smart speakers and Google Assistant smartphone apps had previously supported.{{Cite web |last=Gartenberg |first=Chaim |date=2017-12-20 |title=Google's latest Assistant SDK updates make third-party speakers smarter |url=https://www.theverge.com/circuitbreaker/2017/12/20/16802554/google-assistant-sdk-update-new-languages-configuration-settings-actions |access-date=2023-11-07 |website=The Verge |language=en}}

The features include:

  • Third-party device makers can incorporate their own "Actions on Google" commands for their respective products
  • Text-based interactions and many languages
  • Users can set a precise geographic location for the device to enable improved location-specific queries.{{Cite web |first=Chaim |last=Gartenberg |title=Google's latest Assistant SDK updates make third-party speakers smarter |url=https://www.theverge.com/circuitbreaker/2017/12/20/16802554/google-assistant-sdk-update-new-languages-configuration-settings-actions |website=The Verge |publisher=Vox Media |date=December 20, 2017 |access-date=December 21, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110040336/https://www.theverge.com/circuitbreaker/2017/12/20/16802554/google-assistant-sdk-update-new-languages-configuration-settings-actions |url-status=live }}{{Cite web |first=Williams |last=Pelegrin |title=Google Assistant SDK updated with new languages and features |url=https://www.androidauthority.com/google-assistant-sdk-updated-824752 |website=Android Authority |date=December 20, 2017 |access-date=December 21, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033615/https://www.androidauthority.com/google-assistant-sdk-updated-824752/ |url-status=live }}

On May 2, 2018, Google announced a new program that focuses on investing in the future of Google Assistant through early-stage startups. Their focus was to build an environment where developers could build richer experiences for their users. This includes startups that broaden Assistant's features, are building new hardware devices, or simply differentiating in different industries.{{cite web |last1=Kapoor |first1=Sanjay |last2=Fox |first2=Nick |title=Investing in startups and the future of the Google Assistant |url=https://www.blog.google/products/assistant/investing-startups-and-future-google-assistant/ |website=Google Blog |access-date=February 12, 2019 |language=en |date=May 2, 2018 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033649/https://www.blog.google/products/assistant/investing-startups-and-future-google-assistant/ |url-status=live }}

= Voices =

Google Assistant launched using the voice of Kiki Baessell for the American female voice, the same actress for the Google Voice voicemail system since 2010.{{Cite web |last=Toff |first=Jason |date=June 28, 2010 |title=The new voice of Google Voice |url=http://googlevoiceblog.blogspot.com/2010/06/new-voice-of-google-voice.html |url-status=live |archive-url=https://web.archive.org/web/20100702145656/http://googlevoiceblog.blogspot.com/2010/06/new-voice-of-google-voice.html |archive-date=July 2, 2010 |access-date=October 14, 2019 |website=Google Voice Blog |publisher=Google |language=en}}

On October 11, 2019, Google announced that Issa Rae had been added to Google Assistant as an optional voice, which could be enabled by the user by saying "Okay, Google, talk like Issa".{{Cite web|url=https://www.instagram.com/p/B3cPBsalahR/ |archive-url=https://ghostarchive.org/iarchive/s/instagram/B3cPBsalahR |archive-date=December 26, 2021 |url-access=registration|title=Google on Instagram: "Meet the new voice of your Google Assistant: @issarae! 🤩 She's taking over our story today—follow along or say "Hey Google, #TalkLikeIssa"..."|website=Instagram|language=en|access-date=October 14, 2019}}{{cbignore}} Although, as of April 2022, Google Assistant response with "Sorry, that voice isn't available anymore, but you can try out another by asking me to change voices." if the command is given.{{Citation needed|date=November 2023}}

Interaction

File:Android Assistant on the Google Pixel XL smartphone (29526761674).jpg phone]]

Google Assistant, in the nature and manner of Google Now, can search the Internet, schedule events and alarms, adjust hardware settings on the user's device, and show information from the user's Google account. Unlike Google Now, however, the Assistant can engage in a two-way conversation, using Google's natural language processing algorithm. Search results are presented in a card format that users can tap to open the page.{{Cite web |first=Sarah Jacobsson |last=Purewal |title=The difference between Google Now and Google Assistant |url=https://www.cnet.com/how-to/the-difference-between-google-now-and-google-assistant/ |work=CNET |publisher=CBS Interactive |date=October 4, 2016 |access-date=March 17, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033646/https://www.cnet.com/how-to/the-difference-between-google-now-and-google-assistant/ |url-status=live }} In February 2017, Google announced that users of Google Home would be able to shop entirely by voice for products through its Google Express shopping service, with products available from Whole Foods Market, Costco, Walgreens, PetSmart, and Bed Bath & Beyond at launch,{{Cite web |first=Billy |last=Steele |title=Google Assistant now helps with your shopping on Google Home (updated) |url=https://www.engadget.com/2017/02/16/google-home-shopping-with-google-assistant/ |work=Engadget |publisher=Oath |date=February 16, 2017 |access-date=December 10, 2017 |archive-date=February 3, 2019 |archive-url=https://web.archive.org/web/20190203010401/https://www.engadget.com/2017/02/16/google-home-shopping-with-google-assistant/ |url-status=live }}{{Cite web |first=Taylor |last=Martin |title=Google Home now lets you shop for everyday items with your voice |url=https://www.cnet.com/how-to/google-home-now-lets-you-shop-for-everyday-items-with-your-voice/ |work=CNET |publisher=CBS Interactive |date=February 16, 2017 |access-date=December 10, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033756/https://www.cnet.com/how-to/google-home-now-lets-you-shop-for-everyday-items-with-your-voice/ |url-status=live }} and other retailers added in the following months as new partnerships were formed.{{Cite web |first=Nathan |last=Ingraham |title=Order from Walmart by chatting with Google Home |url=https://www.engadget.com/2017/09/25/google-home-walmart-shopping/ |work=Engadget |publisher=Verizon Media |date=September 25, 2017 |access-date=December 10, 2017 |archive-date=March 22, 2020 |archive-url=https://web.archive.org/web/20200322202246/https://www.engadget.com/2017/09/25/google-home-walmart-shopping/ |url-status=live }}{{Cite web |first=Anne |last=D'innocenzio |title=Target is joining forces with Google to take on Amazon |url=http://www.businessinsider.com/ap-target-joins-other-retailers-in-offering-voice-shopping-2017-10 |work=Business Insider |publisher=Axel Springer SE |date=October 12, 2017 |access-date=December 10, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033710/https://www.businessinsider.com/ap-target-joins-other-retailers-in-offering-voice-shopping-2017-10 |url-status=live }} Google Assistant can maintain a shopping list; this was previously done within the notetaking service GKeep, but the feature was moved to Google Express and the Google Home app in April 2017, resulting in a severe loss of functionality.{{Cite web |first=Ron |last=Amadeo |title=Google ruins the Assistant's shopping list, turns it into a big Google Express ad |url=https://arstechnica.com/gadgets/2017/04/google-ruins-the-assistants-shopping-list-turns-it-into-a-big-google-express-ad/ |work=Ars Technica |publisher=Condé Nast |date=April 11, 2017 |access-date=May 30, 2017 |archive-date=December 22, 2020 |archive-url=https://web.archive.org/web/20201222225750/https://arstechnica.com/gadgets/2017/04/google-ruins-the-assistants-shopping-list-turns-it-into-a-big-google-express-ad/ |url-status=live }}{{Cite web |first=Natt |last=Garun |title=Google Assistant's shopping lists are moving to the Home app today |url=https://www.theverge.com/2017/4/10/15242636/google-assistant-shopping-list-update-home-express |work=The Verge |publisher=Vox Media |date=April 10, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033732/https://www.theverge.com/2017/4/10/15242636/google-assistant-shopping-list-update-home-express |url-status=live }}

In May 2017, Google announced that the Assistant would support a keyboard for typed input and visual responses,{{Cite web |first=Dieter |last=Bohn |title=You can finally use the keyboard to ask Google Assistant questions |url=https://www.theverge.com/2017/5/17/15648472/google-assistant-keyboard-input-announced-io-2017 |work=The Verge |publisher=Vox Media |date=May 17, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033733/https://www.theverge.com/2017/5/17/15648472/google-assistant-keyboard-input-announced-io-2017 |url-status=live }}{{Cite web |first=Rob |last=LeFebvre |title=Google Assistant now accepts typed and verbal cues |url=https://www.engadget.com/2017/05/17/google-assistant-now-accepts-typed-and-verbal-cues/ |work=Engadget |publisher=AOL |date=May 17, 2017 |access-date=May 30, 2017 |archive-date=December 10, 2019 |archive-url=https://web.archive.org/web/20191210135334/https://www.engadget.com/2017/05/17/google-assistant-now-accepts-typed-and-verbal-cues/ |url-status=live }} support identifying objects and gather visual information through the device's camera,{{Cite web |first=Chris |last=Welch |title=Google Assistant will soon search by sight with your smartphone camera |url=https://www.theverge.com/2017/5/17/15648128/google-assistant-camera-sight-search-feature-io-2017 |work=The Verge |publisher=Vox Media |date=May 17, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033721/https://www.theverge.com/2017/5/17/15648128/google-assistant-camera-sight-search-feature-io-2017 |url-status=live }}{{Cite web |first=Jessica |last=Conditt |title=Google Lens is a powerful, AI-driven visual search app |url=https://www.engadget.com/2017/05/17/google-lens-brings-ai-understanding-to-assistant-and-photos/ |work=Engadget |publisher=AOL |date=May 17, 2017 |access-date=May 30, 2017 |archive-date=February 4, 2020 |archive-url=https://web.archive.org/web/20200204024706/https://www.engadget.com/2017/05/17/google-lens-brings-ai-understanding-to-assistant-and-photos/ |url-status=live }} and support purchasing products{{Cite web |first=Natt |last=Garun |title=You can buy stuff with Google Assistant now |url=https://www.theverge.com/2017/5/17/15648132/google-assistant-wallet-integration-order-delivery-io-2017 |work=The Verge |publisher=Vox Media |date=May 17, 2017 |access-date=May 30, 2017 |archive-date=November 12, 2020 |archive-url=https://web.archive.org/web/20201112003218/https://www.theverge.com/2017/5/17/15648132/google-assistant-wallet-integration-order-delivery-io-2017 |url-status=live }}{{Cite web |first=Joan E |last=Solsman |title=Google Assistant wants to make buying stuff easier. Just ask it |url=https://www.cnet.com/news/google-assistant-transactions/ |work=CNET |publisher=CBS Interactive |date=May 17, 2017 |access-date=May 30, 2017 |archive-date=November 12, 2020 |archive-url=https://web.archive.org/web/20201112034943/https://www.cnet.com/news/google-assistant-transactions/ |url-status=live }} and sending money.{{Cite web |first=Scott |last=Scrivens |title=Google Assistant will soon support sending money with your Google account |url=http://www.androidpolice.com/2017/05/18/google-assistant-will-soon-support-sending-money-google-account/ |work=Android Police |date=May 18, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110040420/https://www.androidpolice.com/2017/05/18/google-assistant-will-soon-support-sending-money-google-account/ |url-status=live }}{{Cite web |first=Paul |last=Miller |title=You'll soon be able to send money with Google Assistant |url=https://www.theverge.com/2017/5/18/15660728/google-assistant-payment-api-peer-to-peer-money-money-money-io-2017 |work=The Verge |publisher=Vox Media |date=May 18, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033754/https://www.theverge.com/2017/5/18/15660728/google-assistant-payment-api-peer-to-peer-money-money-money-io-2017 |url-status=live }} Through the use of the keyboard, users can see a history of queries made to the Google Assistant, and edit or delete previous inputs. The Assistant warns against deleting, however, due to its use of previous inputs to generate better answers in the future.{{Cite web |first=Ryan |last=Whitwam |title=Google Assistant on Android now has query history that you can edit or delete |url=http://www.androidpolice.com/2017/05/18/google-assistant-android-now-query-history-can-edit-delete/ |work=Android Police |date=May 18, 2017 |access-date=May 30, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033729/https://www.androidpolice.com/2017/05/18/google-assistant-android-now-query-history-can-edit-delete/ |url-status=live }} In November 2017, it became possible to identify songs currently playing by asking the Assistant.{{Cite web |first=Shannon |last=Liao |title=Google Assistant can now tell you what song is playing near you |url=https://www.theverge.com/2017/11/6/16615700/google-assistant-shazam-like-what-song-is-this |work=The Verge |publisher=Vox Media |date=November 6, 2017 |access-date=December 10, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110040402/https://www.theverge.com/2017/11/6/16615700/google-assistant-shazam-like-what-song-is-this |url-status=live }}{{Cite web |first=Abner |last=Li |title=Google Assistant can finally recognize music and songs, rolling out now |url=https://9to5google.com/2017/11/06/google-assistant-song-music-recognition/ |work=9to5Google |date=November 6, 2017 |access-date=December 10, 2017 |archive-date=January 10, 2021 |archive-url=https://web.archive.org/web/20210110033845/https://9to5google.com/2017/11/06/google-assistant-song-music-recognition/ |url-status=live }}

The Google Assistant allows users to activate and modify vocal shortcut commands in order to perform actions on their device (both Android and iPad/iPhone) or configure it as a hub for home automation.

This feature of the speech recognition is available in English, among other languages.{{cite web | url = https://support.google.com/assistant/answer/7390802?co=GENIE.Platform%3DAndroid&hl=en | title = Create shortcut commands| access-date = October 12, 2018 | work=Google Support | archive-url = https://web.archive.org/web/20181012092650/https://support.google.com/assistant/answer/7390802?co=GENIE.Platform%3DAndroid&hl=en | archive-date = October 12, 2018 | url-status = live}}{{Cite web|url=https://www.forbes.com/sites/kevinmurnane/2017/05/23/how-to-set-up-google-assistants-little-known-and-super-useful-shortcuts/|title=How To Set Up Google Assistant's Little-Known And Super-Useful Shortcuts|last=Murnane|first=Kevin|date=May 23, 2017|work=Forbes|archive-url=https://archive.today/20181012092147/https://www.forbes.com/sites/kevinmurnane/2017/05/23/how-to-set-up-google-assistants-little-known-and-super-useful-shortcuts/%2314545f6e5e32|archive-date=October 12, 2018|url-status=live|access-date=December 20, 2018}} In July 2018, the Google Home version of Assistant gained support for multiple actions triggered by a single vocal shortcut command.{{cite web | first1 = Ryan | last1 = Whitwam | url = https://www.pcworld.com/article/3205867/android/google-assistant-tips-tricks.html | title = Google Assistant: Awesome features you need to start using. Trigger multiple commands. | date = July 3, 2018 | access-date = October 12, 2018 | publisher=PC World| archive-url = https://web.archive.org/web/20180405115932/https://www.pcworld.com/article/3205867/android/google-assistant-tips-tricks.html | archive-date = April 5, 2018 | url-status = live}}

At the annual I/O developers conference on May 8, 2018, Google's SEO announced the addition of six new voice options for the Google Assistant, one of which being John Legend's.{{Cite news|url=https://www.engadget.com/2018/05/08/john-legend-google-assistant-voice/|title=John Legend is one of six new Google Assistant voices|last=Tarantola|first=Andrew|date=May 8, 2018|work=Engadget|access-date=May 9, 2018|archive-date=December 10, 2019|archive-url=https://web.archive.org/web/20191210135335/https://www.engadget.com/2018/05/08/john-legend-google-assistant-voice/|url-status=live}} This was made possible by WaveNet, a voice synthesizer developed by DeepMind, which significantly reduced the amount of audio samples that a voice actor was required to produce for creating a voice model.{{Cite news|url=https://www.cnet.com/how-to/how-to-get-all-google-assistants-new-voices-right-now/|title=Try the all-new Google Assistant voices right now|last=Martin|first=Taylor|date=May 9, 2018|work=CNET|access-date=May 10, 2018|archive-date=January 25, 2021|archive-url=https://web.archive.org/web/20210125100520/https://www.cnet.com/how-to/how-to-get-all-google-assistants-new-voices-right-now/|url-status=live}} However, John Legend's Google Assistant cameo voice was discontinued on March 23, 2020.{{Cite web|url=https://www.theverge.com/2020/3/5/21166751/google-john-legend-assistant-end-celebrity-cameo-voice|title=Google will lose its John Legend Google Assistant voice on March 23rd|last=Garun|first=Natt|date=May 3, 2020|work=The Verge|access-date=June 3, 2020|archive-date=August 1, 2020|archive-url=https://web.archive.org/web/20200801085327/https://www.theverge.com/2020/3/5/21166751/google-john-legend-assistant-end-celebrity-cameo-voice|url-status=live}}{{Cite web|url=https://www.androidpolice.com/2020/03/05/john-legends-google-assistant-cameo-voice-goes-away-march-23/|title=John Legend's Google Assistant cameo voice goes away March 23|date=March 5, 2020|work=Android Police|access-date=June 3, 2020|archive-date=September 30, 2020|archive-url=https://web.archive.org/web/20200930034634/https://www.androidpolice.com/2020/03/05/john-legends-google-assistant-cameo-voice-goes-away-march-23/|url-status=live}}

In August 2018, Google added bilingual capabilities to the Google Assistant for existing supported languages on devices. Recent reports say that it may support multilingual support by setting a third default language on Android Phone.{{Cite web|url=https://techcrunch.com/2018/08/30/the-google-assistant-is-now-bilingual/|title=The Google Assistant is now bilingual|last=Lardinois|first=Frederic|date=August 30, 2018|work=TechCrunch|access-date=December 12, 2018|archive-date=January 10, 2021|archive-url=https://web.archive.org/web/20210110033722/https://techcrunch.com/2018/08/30/the-google-assistant-is-now-bilingual/|url-status=live}}

Speech-to-Text can recognize commas, question marks, and periods in transcription requests.{{cite web | url = https://cloud.google.com/speech-to-text/docs/automatic-punctuation | title = Getting Punctuation on Speech-to-Text | work=Google Support | access-date = October 12, 2018 | archive-url = https://web.archive.org/web/20180624205129/https://cloud.google.com/speech-to-text/docs/automatic-punctuation | archive-date = June 24, 2018 | url-status = live }}

In April 2019, the most popular audio games in the Assistant, Crystal Ball, and Lucky Trivia, have had the biggest voice changes in the application's history. The voice in the assistant has been able to add expression to the games. For instance, in the Crystal Ball game, the voice would speak slowly and softly during the intro and before the answer is revealed to make the game more exciting, and in the Lucky Trivia game, the voice would become excitable like a game show host. In the British accent voice of Crystal Ball, the voice would say the word 'probably' in a downward slide like she's not too sure. The games used the text-to-speech voice which makes the voice more robotic. In May 2019 however, it turned out to be a bug in the speech API that caused the games to lose the studio-quality voices. These audio games were fixed in May 2019.

=Interpreter Mode=

On December 12, 2019, Google debuted an interpreter mode in Google Assistant smartphone apps for Android and iOS. It provides translation of conversations in real-time and was previously only available on Google Home smart speakers and displays.{{Cite web|url=https://www.theverge.com/2019/12/12/21010451/google-assistant-interpreter-mode-android-ios-apps|title=Google Assistant's interpreter mode is coming to phones today|last=Byford|first=Sam|date=December 12, 2019|work=The Verge|access-date=December 13, 2019|archive-date=August 1, 2020|archive-url=https://web.archive.org/web/20200801044948/https://www.theverge.com/2019/12/12/21010451/google-assistant-interpreter-mode-android-ios-apps|url-status=live}} Google Assistant won the 2020 Webby Award for Best User Experience in the category: Apps, Mobile & Voice.{{cite web |last1=Kastrenakes |first1=Jacob |title=Here are all the winners of the 2020 Webby Awards |url=https://www.theverge.com/2020/5/20/21263445/2020-webby-awards-winners-lil-nas-x-nasa-jon-krasinski |work=The Verge |access-date=May 22, 2020 |date=May 20, 2020 |archive-date=May 21, 2020 |archive-url=https://web.archive.org/web/20200521205535/https://www.theverge.com/2020/5/20/21263445/2020-webby-awards-winners-lil-nas-x-nasa-jon-krasinski |url-status=live }}

On March 5, 2020, Google introduced a feature on Google Assistant that read webpages aloud in 42 languages.{{Cite web|url=https://www.theverge.com/2020/3/4/21164510/google-assistant-screen-reading-feature-accessibility-translation|title=Google Assistant can now read webpages aloud in 42 different languages|last=Garun|first=Natt|date=March 4, 2020|work=The Verge|access-date=November 9, 2021|archive-date=September 30, 2020|archive-url=https://web.archive.org/web/20200930024105/https://www.theverge.com/2020/3/4/21164510/google-assistant-screen-reading-feature-accessibility-translation|url-status=live}}{{Cite web|url=http://techcrunch.com/2020/03/04/google-assistant-on-android-can-now-read-entire-web-pages-to-you/|title=Google Assistant on Android can now read entire web pages to you|date=March 4, 2020|work=TechCrunch|access-date=November 9, 2021}}

On October 15, 2020, Google announced a new 'hum to search' function to find a song by simply humming, whistling, or singing the song.{{cite web|url=https://blog.google/products/search/hum-to-search|title=Song stuck in your head? Just hum to search|access-date=October 15, 2020|publisher=Google|date=October 15, 2020|archive-date=January 28, 2021|archive-url=https://web.archive.org/web/20210128121446/https://blog.google/products/search/hum-to-search/|url-status=live}}{{Cite web |date=2022-10-04 |title=How to Find a Song by Humming - Google Hum to Search |url=https://www.techmaish.com/how-to-find-a-song-by-humming/ |access-date=2022-11-19 |website=www.techmaish.com |language=en-US |archive-date=November 19, 2022 |archive-url=https://web.archive.org/web/20221119181505/https://www.techmaish.com/how-to-find-a-song-by-humming/ |url-status=live }}

= Google Duplex =

{{about|section=y|Duplex for Google Assistant|the number|googolplex}}

In May 2018, Google revealed Duplex, an extension of the Google Assistant that allows it to carry out natural conversations by mimicking human voice, in a manner not dissimilar to robocalling.{{Cite news|date=May 8, 2018|first1=Yaniv|last1=Leviathan|first2=Yossi|last2=Matias|url=https://ai.googleblog.com/2018/05/duplex-ai-system-for-natural-conversation.html|title=Google Duplex: An AI System for Accomplishing Real-World Tasks Over the Phone|work=Google AI Blog|access-date=October 15, 2018|archive-date=February 1, 2021|archive-url=https://web.archive.org/web/20210201225000/https://ai.googleblog.com/2018/05/duplex-ai-system-for-natural-conversation.html|url-status=live}} The assistant can autonomously complete tasks such as calling a hair salon to book an appointment, scheduling a restaurant reservation, or calling businesses to verify holiday store hours.{{Cite news|url=https://www.cnet.com/features/google-assistant-duplex-at-io-could-become-the-most-lifelike-ai-voice-assistant-yet/|title=Google Assistant's one step closer to passing the Turing test|last=Nieva|first=Richard|date=May 9, 2018|work=CNET|access-date=May 10, 2018|archive-date=January 10, 2021|archive-url=https://web.archive.org/web/20210110033907/https://www.cnet.com/features/google-assistant-duplex-at-io-could-become-the-most-lifelike-ai-voice-assistant-yet/|url-status=live}} While Duplex can complete most of its tasks fully autonomously, it is able to recognize situations that it is unable to complete and can signal a human operator to finish the task. Duplex was created to speak in a more natural voice and language by incorporating speech disfluencies such as filler words like "hmm" and "uh" and using common phrases such as "mhm" and "gotcha", along with more human-like intonation and response latency.{{Cite news|url=https://ai.googleblog.com/2018/05/duplex-ai-system-for-natural-conversation.html|title=Google Duplex: An AI System for Accomplishing Real-World Tasks Over the Phone|last1=Leviathan|first1=Yaniv|date=May 8, 2018|work=Google AI Blog|access-date=May 10, 2018|last2=Matias|first2=Yossi|archive-date=February 1, 2021|archive-url=https://web.archive.org/web/20210201225000/https://ai.googleblog.com/2018/05/duplex-ai-system-for-natural-conversation.html|url-status=live}}{{Cite news|url=https://www.cnet.com/news/google-duplex-assistant-bot-deception-scary-ethics-question/|title=Human or bot? Google Duplex scares me|last=Carey|first=Bridget|date=May 9, 2018|work=CNET|access-date=May 10, 2018|archive-date=January 10, 2021|archive-url=https://web.archive.org/web/20210110033925/https://www.cnet.com/news/google-duplex-assistant-bot-deception-scary-ethics-question/|url-status=live}}{{Cite news|url=https://www.bloomberg.com/news/articles/2018-05-10/google-grapples-with-horrifying-reaction-to-uncanny-ai-tech|title=Google Grapples With 'Horrifying' Reaction to Uncanny AI Tech|last=Bergen|first=Mark|date=May 10, 2018|work=Bloomberg LP|access-date=December 20, 2018|archive-date=October 31, 2020|archive-url=https://web.archive.org/web/20201031014805/https://www.bloomberg.com/news/articles/2018-05-10/google-grapples-with-horrifying-reaction-to-uncanny-ai-tech|url-status=live}} Duplex is currently in development and had a limited release in late 2018 for Google Pixel users.{{Cite news|url=https://www.theverge.com/2018/5/8/17332070/google-assistant-makes-phone-call-demo-duplex-io-2018|title=Google just gave a stunning demo of Assistant making an actual phone call|last=Welch|first=Chris|date=May 8, 2018|work=The Verge|access-date=May 20, 2018|archive-date=January 27, 2021|archive-url=https://web.archive.org/web/20210127004845/https://www.theverge.com/2018/5/8/17332070/google-assistant-makes-phone-call-demo-duplex-io-2018|url-status=live}} During the limited release, Pixel phone users in Atlanta, New York, Phoenix, and San Francisco were only able to use Duplex to make restaurant reservations.{{Cite news|url=https://www.wired.com/story/google-duplex-pixel-smartphone/?mbid=social_twitter_onsiteshare|title=Google Duplex, the Human-Sounding Phone Bot, Comes to the Pixel|last=Simonite|first=Tom|date=October 9, 2018|magazine=Wired|access-date=October 10, 2018|archive-date=January 10, 2021|archive-url=https://web.archive.org/web/20210110033911/https://www.wired.com/story/google-duplex-pixel-smartphone/?mbid=social_twitter_onsiteshare|url-status=live}} As of October 2020, Google has expanded Duplex to businesses in eight countries.{{Cite web|title=Duplex, Google's conversational AI, has updated 3M+ business listings since pandemic|url=https://techcrunch.com/2020/10/15/duplex-googles-conversational-a-i-has-updated-3m-business-listings-since-pandemic/|access-date=October 16, 2020|work=TechCrunch|date=October 15, 2020}}{{Cite web|date=October 15, 2020|title=Duplex is getting smarter and making life a little easier|url=https://blog.google/technology/ai/duplex-helpful-updates/|access-date=October 16, 2020|publisher=Google|archive-date=December 12, 2020|archive-url=https://web.archive.org/web/20201212170847/https://www.blog.google/technology/ai/duplex-helpful-updates|url-status=live}}

== Criticism ==

After the announcement, concerns were made over the ethical and societal questions that artificial intelligence technology such as Duplex raises.{{Cite news|url=https://www.engadget.com/2018/05/11/google-duplex-ai-tough-questions-answers-now/|title=Google's AI advances are equal parts worry and wonder|last=Low|first=Cherlynn|date=May 11, 2018|work=Engadget|access-date=May 14, 2018|archive-date=June 10, 2019|archive-url=https://web.archive.org/web/20190610215810/https://www.engadget.com/2018/05/11/google-duplex-ai-tough-questions-answers-now/|url-status=live}} For instance, human operators may not notice that they are speaking with a digital robot when conversing with Duplex,{{Cite news|url=https://qz.com/1275036/its-googles-turn-to-ask-the-questions/|title=It's Google's turn to ask the questions|last=Gershgorn|first=Dave|date=May 12, 2018|work=Quartz|access-date=May 14, 2018|archive-date=January 10, 2021|archive-url=https://web.archive.org/web/20210110033910/https://qz.com/1275036/its-googles-turn-to-ask-the-questions/|url-status=live}} which some critics view as unethical or deceitful.{{Cite news|url=https://globalnews.ca/news/4204648/googles-ai-identify-itself-robot-phone-calls/|title=Google's AI assistant must identify itself as a robot during phone calls: report|last=Vomiero|first=Jessica|date=May 12, 2018|work=Global News|access-date=May 14, 2018|archive-date=January 12, 2021|archive-url=https://web.archive.org/web/20210112212914/https://globalnews.ca/news/4204648/googles-ai-identify-itself-robot-phone-calls/|url-status=live}} Concerns over privacy were also identified, as conversations with Duplex are recorded in order for the virtual assistant to analyze and respond.{{Cite news|url=https://www.theverge.com/2018/5/11/17340894/google-duplex-all-party-consent-state-eavesdropping|title=No one knows how Google Duplex will work with eavesdropping laws|last=Jeong|first=Sarah|date=May 11, 2018|work=The Verge|access-date=May 14, 2018|archive-date=January 10, 2021|archive-url=https://web.archive.org/web/20210110033900/https://www.theverge.com/2018/5/11/17340894/google-duplex-all-party-consent-state-eavesdropping|url-status=live}} Privacy advocates have also raised concerns around how the millions of vocal samples gathered from consumers are fed back into the algorithms of virtual assistants, making these forms of AI smarter with each use. Though these features individualize the user experience, critics are unsure about the long term implications of giving "the company unprecedented access to human patterns and preferences that are crucial to the next phase of artificial intelligence".{{Cite web|url=https://www.engadget.com/2016/10/05/personal-assistants-google-home-ai/|title=Personal Assistants are Ushering in the Age of AI at home|last=Lulwani|first=Mona|date=October 5, 2016|work=Engadget|access-date=May 30, 2018|archive-date=December 10, 2019|archive-url=https://web.archive.org/web/20191210135331/https://www.engadget.com/2016/10/05/personal-assistants-google-home-ai/|url-status=live}}

While transparency was referred to as a key part to the experience when the technology was revealed,{{Cite news|url=https://ai.googleblog.com/2018/05/duplex-ai-system-for-natural-conversation.html|title=Google Duplex: An AI System for Accomplishing Real-World Tasks Over the Phone|last1=Leviathan|first1=Yaniv|date=August 5, 2018|work=Google AI Blog|access-date=May 10, 2018|last2=Matias|first2=Yossi|archive-date=February 1, 2021|archive-url=https://web.archive.org/web/20210201225000/https://ai.googleblog.com/2018/05/duplex-ai-system-for-natural-conversation.html|url-status=live}} Google later further clarified in a statement saying, "We are designing this feature with disclosure built-in, and we'll make sure the system is appropriately identified."{{Cite news|url=https://www.theverge.com/2018/5/10/17342414/google-duplex-ai-assistant-voice-calling-identify-itself-update|title=Google now says controversial AI voice calling system will identify itself to humans|work=The Verge|access-date=May 14, 2018|first=Nick|last=Statt|date=May 10, 2018|archive-date=November 20, 2020|archive-url=https://web.archive.org/web/20201120210057/https://www.theverge.com/2018/5/10/17342414/google-duplex-ai-assistant-voice-calling-identify-itself-update|url-status=live}} Google further added that, in certain jurisdictions, the assistant would inform those on the other end of the phone that the call is being recorded.{{Cite news|url=https://www.bloomberg.com/news/articles/2018-05-18/google-s-duplex-ai-robot-will-warn-that-calls-are-recorded|title=Google's Duplex AI Robot Will Warn That Calls Are Recorded|last=Bergen|first=Mark|date=May 18, 2018|publisher=Bloomberg|access-date=May 20, 2018|archive-date=November 9, 2020|archive-url=https://web.archive.org/web/20201109013951/https://www.bloomberg.com/news/articles/2018-05-18/google-s-duplex-ai-robot-will-warn-that-calls-are-recorded|url-status=live}}

Reception

PC World's Mark Hachman gave a favorable review of the Google Assistant, saying that it was a "step up on Cortana and Siri."{{Cite web|url=http://www.pcworld.com/article/3122482/android/hands-on-google-assistants-allo-chatbot-outdoes-cortana-siri-as-your-digital-pal.html|title=Hands-on: Google Assistant's Allo chatbot outdoes Cortana, Siri as your digital pal|last=Hachman|first=Mark|date=September 22, 2016|website=PC World|publisher=International Data Group|access-date=March 17, 2017|archive-date=September 23, 2016|archive-url=https://web.archive.org/web/20160923172020/http://www.pcworld.com/article/3122482/android/hands-on-google-assistants-allo-chatbot-outdoes-cortana-siri-as-your-digital-pal.html|url-status=live}} Digital Trends called it "smarter than Google Now ever was".{{Cite news|url=https://www.digitaltrends.com/mobile/google-assistant/|title=Google Assistant: Everything You Need To Know About The A.I.|date=July 17, 2018|work=Digital Trends|access-date=October 12, 2018|language=en-US|archive-date=October 13, 2018|archive-url=https://web.archive.org/web/20181013014248/https://www.digitaltrends.com/mobile/google-assistant/|url-status=live}}

Criticism

In July 2019 Belgian public broadcaster VRT NWS published an article revealing that third-party contractors paid to transcribe audio clips collected by Google Assistant listened to sensitive information about users. Sensitive data collected from Google Home devices and Android phones included names, addresses, and other private conversations after mistaken hot word triggering, such as business calls or bedroom conversations.{{Cite news|url=https://economictimes.indiatimes.com/magazines/panache/beware-google-assistant-records-conversations-and-contractors-can-listen-to-your-bedroom-talk-any-time/articleshow/70190336.cms|title=Beware! Google Assistant records conversations, and contractors can listen to your bedroom talk any time|date=July 12, 2019|work=The Economic Times|access-date=January 10, 2020|archive-date=December 22, 2020|archive-url=https://web.archive.org/web/20201222144153/https://economictimes.indiatimes.com/magazines/panache/beware-google-assistant-records-conversations-and-contractors-can-listen-to-your-bedroom-talk-any-time/articleshow/70190336.cms|url-status=live}} From more than 1,000 recordings analyzed, 153 were recorded without the "OK Google" command. Google officially acknowledged that 0.2% of recordings are being listened to by language experts to improve Google's services.{{Cite web|url=https://www.vrt.be/vrtnws/en/2019/07/10/google-employees-are-eavesdropping-even-in-flemish-living-rooms/|title=Google employees are eavesdropping, even in your living room, VRT NWS has discovered|last=News|first=Flanders|date=July 10, 2019|website=vrtnws.be|language=en|access-date=August 3, 2019|archive-date=January 29, 2021|archive-url=https://web.archive.org/web/20210129122215/https://www.vrt.be/vrtnws/en/2019/07/10/google-employees-are-eavesdropping-even-in-flemish-living-rooms/|url-status=live}} On August 1, 2019, Germany's Hamburg Commissioner for Data Protection and Freedom of Information initiated an administrative procedure to prohibit Google from carrying out corresponding evaluations by employees or third parties for the period of three months to provisionally protect the rights of privacy of data subjects for the time being, citing GDPR.{{Cite web|url=https://datenschutz-hamburg.de/assets/pdf/2019-08-01_press-release-Google_Assistant.pdf|title=Data protection authority opens administrative proceedings against Google|date=August 1, 2019|website=The Hamburg Commissioner for Data Protection and Freedom of Information|archive-url=https://web.archive.org/web/20190803162217/https://datenschutz-hamburg.de/assets/pdf/2019-08-01_press-release-Google_Assistant.pdf|archive-date=August 3, 2019}} A Google spokesperson stated that Google paused "language reviews" in all European countries while it investigated recent media leaks.{{Cite web|url=https://www.theverge.com/2019/8/1/20750327/google-assistant-voice-recording-investigation-europe|title=Google will pause listening to EU voice recordings while regulators investigate|last=Lecher|first=Colin|date=August 1, 2019|website=The Verge|access-date=August 3, 2019|archive-date=January 17, 2021|archive-url=https://web.archive.org/web/20210117021110/https://www.theverge.com/2019/8/1/20750327/google-assistant-voice-recording-investigation-europe/|url-status=live}}

See also

References

{{Reflist|30em}}