Bingbot

{{Short description|Web-crawling robot}}

{{Infobox software

| name = Bingbot

| screenshot =

| logo = Bing Fluent Logo Text.svg

| caption =

| author = Microsoft

| developer =

| released =

| discontinued =

| latest release version =

| latest release date =

| latest preview version =

| latest preview date =

| programming language =

| operating system =

| platform =

| size =

| language =

| genre = Web crawler

| license =

| website = [https://www.bing.com/toolbox/verify-bingbot Bingbot FAQ]

}}

Bingbot is a web-crawling robot (type of internet bot), deployed by Microsoft October 2010 to supply Bing.{{Cite web|url = https://www.seroundtable.com/bingbot-crawling-much-16273.html|title = BingBot Crawl Activity Surging?| date=28 January 2013 |access-date = 2016-07-16}} It collects documents from the web to build a searchable index for the Bing (search engine). It performs the same as Google's Googlebot.{{Cite book |last1=Shenoy |first1=Aravind |url=https://books.google.com/books?id=Hpe-DAAAQBAJ&dq=Bing++performs+the+same+as+Google's+Googlebot&pg=PA13 |title=Introducing SEO: Your quick-start guide to effective SEO practices |last2=Prabhu |first2=Anirudh |date=2016-07-26 |publisher=Apress |isbn=978-1-4842-1854-9 |language=en}}

Behavior

A typical user agent string for Bingbot is {{mono|"Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"}}. This appears in the web server logs to tell the webmaster who is requesting a file. Each webmaster is able to use the included agent identifier, "bingbot", to disallow or allow access to their site (by default access is allowed).{{Cite book |last=Team |first=IntroBooks |url=https://books.google.com/books?id=gJf8DwAAQBAJ&q=how+Bingbot+work |title=Microsoft Bing's Algorithm Explained |publisher=IntroBooks |language=en}} If they don't want to grant access, they can use the Robots Exclusion Standard to block it (relying on the assumed good behaviour of bingbot), or use other server specific means (relying on the web server to do the blocking).{{Cite web |last=Siegler |first=M. G. |date=2009-07-17 |title=Ignore That Scary MSNbot, It's Just The Friendly BingBot - Unless It Attacks! |url=https://techcrunch.com/2009/07/17/ignore-that-scary-msnbot-its-just-the-friendly-bingbot-unless-it-attacks/ |access-date=2023-10-22 |website=TechCrunch |language=en-US}}

References