Chinyorwa Directory
Baidu Spider inokambaira uye inoongorora ruzivo rusina kujairika: Chii chandinofanira kuita kana soketi ikaverengwa kana kunyorwa?
Tichifunga kuti webhusaiti yako haina kunyorwa neBaidu, iwe unofanirwa kutanga waita spider kukambaira kuongororwa paBaidu yekutsvaga zviwanikwa papuratifomu.
Chii chandinofanira kuita kana chinokambaira cheBaidu chikatadza kukambaira chinongedzo chekuongorora?
Kana Baidu crawler ikatadza kukambaira nekuongorora kakati wandei, firewall inogona kunge yakavharira chinokambaira.
Baidu Search Resource Platform > Crawling Diagnostics > Ruzivo rweKukanganisa kweKukambaira: Kukanganisa kweKuverenga/Kunyora paSocket ▼

- Kunyanya kushandisaCloudflare Kana uchishandisa CDN, inovharwa nedefault.
- PaInternet, pane kutaura kwekuwedzera IP kero
xxx.xxx.xxx.xxx/24 - Zvisinei, akaedza pasina chimuko.
Ini handisi kuvharira Baidu spider paserver, saka dambudziko rinofanira kunge riri Cloudflare's WAF!
Saina ku Cloudflare → Chengetedzo → WAF → Mitemo yeFirewall → Gadzira Firewall Rule
- Kutsvaga mitemo yeWAF inoenderana nevanokambaira paCloudflare uye wakawana "Legal Robot Crawler" sarudzo ▼

- Mushure mekugadzira mitemo ye firewall, mirira kwemaminitsi gumi, uye wobva wabata chirwere chacho, uye vose vanobudirira kubata!
Baidu crawler Sitemap yatadza kukambaira, connection yapera nguva here?
Kana iyo sitemap faira kero ikatumirwa paBaidu yekutsvaga zviwanikwa papuratifomu, pachave nematambudziko ekukambaira kutadza uye yekubatanidza nguva yekupera ▼

Baidu crawler yatadza kukamba yeSitemap mepu mhinduro
Saina ku Cloudflare → Chengetedzo → WAF → Mitemo yeFirewall → Gadzira Mitemo yeFirewall ▼

- munda, sarudza Mushandisi-Mumiriri
- opareta, sarudza "ine"
- Wedzera mushandisi mutsva, tinya "Kana" kumagumo
- kukosha, isa inotevera Baidu Spider UA mushandisi mumiriri zvakateerana:
-
Baiduspider/2.0 -
Baiduspider-image -
Baiduspider-render/2.0 -
http://www.baidu.com/search/spider.html -
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) -
Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
Mushure mekupedza, edza uye tora zvakare, uye mhedzisiro inodzosa HTTP musoro 200, zvichiratidza kuti kutora kwabudirira▼
-
抓取诊断 > 抓取详情以下是百度Spider抓取结果及页面信息: -
提交网址: https://www.etufo.org/sitemap_baidu.xml -
抓取网址: https://www.etufo.org/sitemap_baidu.xml -
抓取UA: Mozilla/5.0 (compatible; Baiduspider/2.0; -
+http://www.baidu.com/search/spider.html) -
抓取时间: 2022-11-11 19:03:44 -
网站IP: 172.***.***.149 -
下载时长: 0.868秒 -
返回HTTP头:HTTP/2 200
Vashandisi vemamwe dandemutande nevanokambaira vanogonawo kuzvitsvaga nenzira imwecheteyo.
Tinovimba kuti chinyorwa chinoti "Maitiro Ekugadzirisa Matambudziko Ekuverenga/Kunyora Socket uye Nguva Dzekubatanidza" chakagoverwa pablog raChen Weiliang ( https://www.chenweiliang.com/ ) chichakubatsira.
Sunungukai kugovera link yechinyorwa chino: https://www.chenweiliang.com/cwl-29315.html
