Google Chrome Extension: Simulate Baidu Search Engine Spider Crawl Visits

Internet marketingpersonnel often need to doSEOanalysis, the analysis of multipleE-commerceIn the process of website, sometimes it is necessary to test the other party's friendly link, whether to block the access of search engine spiders?

We can passsoftwareTool that simulates the browsing of search engine spiders.

Chen WeiliangRecommended to useGoogle ChromeSimulate the visit of search engine spiders such as Baidu and Google.

This article uses Google Chrome browser as a tutorial.

Chrome extension: User-Agent Switcher for Chrome

step 1:Download the Chrome extension

Extensions → Get More Extensions → Search "User-Agent Switcher for Chrome” → Click “+ ADD TO CHROME”▼

Google Chrome Extension: Simulate Baidu Search Engine Spider Crawl Visits

step 2:Refresh Google Chrome and you will notice that the plugin is loaded ▼

Chrome Loaded Extension: User-Agent Switcher for Chrome Sheet 2

step 3:Go to User-Agent Switcher for Chrome "Options"

Right-click on the User-Agent Switcher for Chrome extension icon and select "Options", it will automatically enter the following options setting page▼

Go to User-Agent Switcher for Chrome "Options" Sheet 3

step 4:Add search engine spider access ID

Add Chrome to simulate search engine spider access identification, such as Baidu, Google ▼

Chrome simulates search engine spider access identification No. 4

Baidu ▼

Mozilla/5.0+(compatible;+Baiduspider/2.0;++http://www.baidu.com/search/spider.html)

Google ▼

Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html)

Sogou ▼

Sogou+web+spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bing ▼

Mozilla/5.0+(compatible;+bingbot/2.0;++http://www.bing.com/bingbot.htm)

step 5:Select the search engine spider to visit the site ▼

User-Agent Switcher for Chrome extension: select search engine spiders to visit the site 5th sheet

  • After the test visit, if it is displayed as usual, it means that the Baidu search engine spider can crawl the web page as usual.

If you can't access the Chrome extension download page on Google's official website, please see the following solutions ▼

Comment

Your email address will not be published. Required fields * Callout

Scroll to Top