BigQuery
{{Short description|Cloud-based data warehouse service}}
{{Third-party|date=May 2023}}
{{Infobox website
| name = BigQuery
| logo =
| logo_size = 128px
| type = Platform as a service data warehouse
| language = English
| current_status = Active
| url = {{URL|https://cloud.google.com/bigquery}}
| registration = Required
| owner = Google
| launch_date = {{start date and age|2010|5|19}}
}}
BigQuery is a managed, serverless data warehouse product by Google, offering scalable analysis over large quantities of data. It is a Platform as a Service (PaaS) that supports querying using a dialect of SQL. It also has built-in machine learning capabilities. BigQuery was announced in May 2010 and made generally available in November 2011.{{Cite web |title= Google opens BigQuery for cloud analytics: Dangles free trial to lure doubters |author= Iain Thomson |website= The Register |date= November 14, 2011 |url= https://www.theregister.co.uk/2011/11/14/google_bigquery_cloud_analytics/ |access-date = August 26, 2016 }}
History
Bigquery originated from Google's internal Dremel technology,{{cite web |author1=Sergey Melnik |author2=Andrey Gubarev |author3=Jing Jing Long |author4=Geoffrey Romer |author5=Shiva Shivakumar |author6=Matt Tolton |author7=Theo Vassilakis |year=2010 |title=Dremel: Interactive Analysis of Web-Scale Datasets |url=http://research.google.com/pubs/pub36632.html |work=Proc. of the 36th International Conference on Very Large Data Bases (VLDB)}}{{Cite web |author=Kazunori Sato |year=2012 |title=An Inside Look at Google BigQuery |url=https://cloud.google.com/files/BigQueryTechnicalWP.pdf |access-date=August 26, 2016}} which enabled quick queries across trillions of rows of data.{{Cite web |last=Kwek |first=Ju-Kay |title=BigQuery: the unlikely birth of a cloud juggernaut |url=https://towardsdatascience.com/bigquery-the-unlikely-birth-of-a-cloud-juggernaut-b5ad476525b7 |access-date=October 20, 2024}} The product was originally announced in May 2010 at Google I/O.{{Cite web |title=Google I/O 2010 - BigQuery and Prediction APIs |url=https://www.youtube.com/watch?v=dbkwv1wjs3A}} Initially, it was only usable by a limited number of external early adopters due to limitations on the API. However, after the product proved its potential, it was released for limited availability in 2011 and general availability in 2012. After general availability, BigQuery found success among a broad range of customers, including airlines, insurance, and retail organizations.
Design
BigQuery requires all requests to be authenticated, supporting a number of Google-proprietary mechanisms as well as OAuth.
Features
- Managing data - Create and delete objects such as tables, views, and user defined functions. Import data from Google Storage in formats such as CSV, Parquet, Avro or JSON.
- Query - Queries are expressed in a SQL dialect{{cite web|title=SQL Reference|url=https://cloud.google.com/bigquery/docs/reference/standard-sql/|access-date=26 June 2017}} and the results are returned in JSON with a maximum reply length of approximately 128 MB, or an unlimited size when large query results are enabled.{{cite web|title=Quota Policy|url=https://cloud.google.com/bigquery/quota-policy#queries|access-date=26 June 2017}}
- Integration - BigQuery can be used from Google Apps Script{{Cite web |title=
BigQuery Service | Apps Script | Google Developers |date= March 15, 2018 |url= https://developers.google.com/apps-script/advanced/bigquery |access-date = April 23, 2018 }} (e.g. as a bound script in Google Docs), or any language that can work with its REST API or client libraries.{{cite web|title=BigQuery Client Libraries|url=https://cloud.google.com/bigquery/docs/reference/libraries|access-date=26 June 2017}} - Access control - Share datasets with arbitrary individuals, groups, or the world.
- Machine learning - Create and execute machine learning models using SQL queries.
References
{{Reflist}}
External links
- {{Official website|https://cloud.google.com/bigquery/what-is-bigquery}}
{{Google LLC}}
{{Google Cloud}}
{{Cloud computing}}