Internet marketingpersonnel often need to doSEOanalysis, the analysis of multipleE-commerceIn the process of website, sometimes it is necessary to test the other party's friendly link, whether to block the access of search engine spiders?
We can passsoftwareTool that simulates the browsing of search engine spiders.
Chen WeiliangRecommended to useGoogle ChromeSimulate the visit of search engine spiders such as Baidu and Google.
This article uses Google Chrome browser as a tutorial.
Chrome extension: User-Agent Switcher for Chrome
step 1:Download the Chrome extension
Extensions → Get More Extensions → Search "User-Agent Switcher for Chrome” → Click “+ ADD TO CHROME”▼
step 2:Refresh Google Chrome and you will notice that the plugin is loaded ▼
step 3:Go to User-Agent Switcher for Chrome "Options"
Right-click on the User-Agent Switcher for Chrome extension icon and select "Options", it will automatically enter the following options setting page▼
step 4:Add search engine spider access ID
Add Chrome to simulate search engine spider access identification, such as Baidu, Google ▼
Baidu ▼
Mozilla/5.0+(compatible;+Baiduspider/2.0;++http://www.baidu.com/search/spider.html)
Google ▼
Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html)
Sogou ▼
Sogou+web+spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
Bing ▼
Mozilla/5.0+(compatible;+bingbot/2.0;++http://www.bing.com/bingbot.htm)
step 5:Select the search engine spider to visit the site ▼
- After the test visit, if it is displayed as usual, it means that the Baidu search engine spider can crawl the web page as usual.
If you can't access the Chrome extension download page on Google's official website, please see the following solutions ▼
Hope Chen Weiliang Blog ( https://www.chenweiliang.com/ ) shared "Google Chrome Extension: Simulate Baidu Search Engine Spider Crawl Visits", which is helpful to you.
Welcome to share the link of this article:https://www.chenweiliang.com/cwl-1038.html
Welcome to the Telegram channel of Chen Weiliang's blog to get the latest updates!
📚 This guide contains huge value, 🌟This is a rare opportunity, don’t miss it! ⏰⌛💨
Share and like if you like!
Your sharing and likes are our continuous motivation!