Chinyorwa Directory
Baidu Spider inokambaira uye inoongorora ruzivo rusina kujairika: Chii chandinofanira kuita kana soketi ikaverengwa kana kunyorwa?
Tichifunga kuti webhusaiti yako haina kunyorwa neBaidu, iwe unofanirwa kutanga waita spider kukambaira kuongororwa paBaidu yekutsvaga zviwanikwa papuratifomu.
Chii chandinofanira kuita kana chinokambaira cheBaidu chikatadza kukambaira chinongedzo chekuongorora?
Kana Baidu crawler ikatadza kukambaira nekuongorora kakati wandei, firewall inogona kunge yakavharira chinokambaira.
Baidu Tsvaga Resource Platform > Crawl Diagnosis > Crawl Abnormal Information: socket kuverenga/kunyora kukanganisa ▼
- Kunyanya kana uchishandisa Cloudflare CDN, iyo yakavharwa nekusarudzika.
- PaInternet, pane kutaura kwekuwedzera IP kero
xxx.xxx.xxx.xxx/24 - Zvisinei, akaedza pasina chimuko.
Ini handisi kuvharira Baidu spider paserver, saka dambudziko rinofanira kunge riri Cloudflare's WAF!
Saina ku Cloudflare → Chengetedzo → WAF → Mitemo yeFirewall → Gadzira Firewall Rule
- Kutsvaga mitemo yeWAF inoenderana nevanokambaira paCloudflare uye wakawana "Legal Robot Crawler" sarudzo ▼
- Mushure mekugadzira mitemo ye firewall, mirira kwemaminitsi gumi, uye wobva wabata chirwere chacho, uye vose vanobudirira kubata!
Baidu crawler Sitemap yatadza kukambaira, connection yapera nguva here?
Kana iyo sitemap faira kero ikatumirwa paBaidu yekutsvaga zviwanikwa papuratifomu, pachave nematambudziko ekukambaira kutadza uye yekubatanidza nguva yekupera ▼
Baidu crawler yatadza kukamba yeSitemap mepu mhinduro
Saina ku Cloudflare → Chengetedzo → WAF → Mitemo yeFirewall → Gadzira Mitemo yeFirewall ▼
- munda, sarudza Mushandisi-Mumiriri
- opareta, sarudza "ine"
- Wedzera mushandisi mutsva, tinya "Kana" kumagumo
- kukosha, isa inotevera Baidu Spider UA mushandisi mumiriri zvakateerana:
-
Baiduspider/2.0 -
Baiduspider-image -
Baiduspider-render/2.0 -
http://www.baidu.com/search/spider.html -
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) -
Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html）
Mushure mekupedza, edza uye tora zvakare, uye mhedzisiro inodzosa HTTP musoro 200, zvichiratidza kuti kutora kwabudirira▼
-
抓取诊断 > 抓取详情以下是百度Spider抓取结果及页面信息： -
提交网址： https://www.etufo.org/sitemap_baidu.xml -
抓取网址： https://www.etufo.org/sitemap_baidu.xml -
抓取UA： Mozilla/5.0 (compatible; Baiduspider/2.0; -
+http://www.baidu.com/search/spider.html) -
抓取时间： 2022-11-11 19:03:44 -
网站IP： 172.***.***.149 -
下载时长： 0.868秒 -
返回HTTP头：HTTP/2 200
Vashandisi vemamwe dandemutande nevanokambaira vanogonawo kuzvitsvaga nenzira imwecheteyo.
Hope Chen Weiliang Blog ( https://www.chenweiliang.com/ ) yakagovaniswa "Baidu dandemutande rinokambaira kutadza kuona abnormal information socket verenga nekunyora zvikanganiso zvekuita nenguva yekubatanidza", izvo zvinobatsira kwauri.
Welcome to share link yechinyorwa chino:https://www.chenweiliang.com/cwl-29315.html
Tikugashirei kuTeregiramu chiteshi cheChen Weiliang's blog kuti uwane zvichangobva kuitika!
📚 Iri gwara rine kukosha kukuru, 🌟Uyu mukana usingawanzo, usapotsa! ⏰⌛💨
Govera uye like kana uchida!
Kugovera kwako uye kuda ndiko kukurudzira kwedu kunoramba kuripo!