Google Chrome Extension: Simulate Baidu Search Engine Spider Crawl Visits

Internet marketingpersonnel often need to doSEOanalysis, the analysis of multipleE-commerceIn the process of website, sometimes it is necessary to test the other party's friendly link, whether to block the access of search engine spiders?

We can passsoftwareTool that simulates the browsing of search engine spiders.

Chen WeiliangRecommended to useGoogle ChromeSimulate the visit of search engine spiders such as Baidu and Google.

This article uses Google Chrome browser as a tutorial.

Chrome extension: User-Agent Switcher for Chrome

step 1:Download the Chrome extension

Extensions → Get More Extensions → Search "User-Agent Switcher for Chrome” → Click “+ ADD TO CHROME”▼

Google Chrome Extension: Simulate Baidu Search Engine Spider Crawl Visits

step 2:Refresh Google Chrome and you will notice that the plugin is loaded ▼

Chrome Loaded Extension: User-Agent Switcher for Chrome Sheet 2

step 3:Go to User-Agent Switcher for Chrome "Options"

Right-click on the User-Agent Switcher for Chrome extension icon and select "Options", it will automatically enter the following options setting page▼

Go to User-Agent Switcher for Chrome "Options" Sheet 3

step 4:Add search engine spider access ID

Add Chrome to simulate search engine spider access identification, such as Baidu, Google ▼

Chrome simulates search engine spider access identification No. 4

Baidu ▼

Mozilla/5.0+(compatible;+Baiduspider/2.0;++http://www.baidu.com/search/spider.html)

Google ▼

Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html)

Sogou ▼

Sogou+web+spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Bing ▼

Mozilla/5.0+(compatible;+bingbot/2.0;++http://www.bing.com/bingbot.htm)

step 5:Select the search engine spider to visit the site ▼

User-Agent Switcher for Chrome extension: select search engine spiders to visit the site 5th sheet

  • After the test visit, if it is displayed as usual, it means that the Baidu search engine spider can crawl the web page as usual.

If you can't access the Chrome extension download page on Google's official website, please see the following solutions ▼

Hope Chen Weiliang Blog ( https://www.chenweiliang.com/ ) shared "Google Chrome Extension: Simulate Baidu Search Engine Spider Crawl Visits", which is helpful to you.

Welcome to share the link of this article:https://www.chenweiliang.com/cwl-1038.html

Welcome to the Telegram channel of Chen Weiliang's blog to get the latest updates!

🔔 Be the first to get the valuable "ChatGPT Content Marketing AI Tool Usage Guide" in the channel top directory! 🌟
📚 This guide contains huge value, 🌟This is a rare opportunity, don’t miss it! ⏰⌛💨
Share and like if you like!
Your sharing and likes are our continuous motivation!

 

Comment

Your email address will not be published. Required fields * Callout

scroll to top