Isalathiso senqaku
I-Baidu Spider ibamba ulwazi olukhethekileyo lokuxilonga: Ndingenza ntoni ukuba isokethi ifundeka kwaye ibhale ngokungachanekanga?
Ukucinga ukuba iwebhusayithi yakho ayiqukwanga ngu-Baidu, kufuneka uqale wenze uxilongo lwesigcawu esigaqayo kwiqonga lokukhangela le-Baidu.
Kufuneka ndenze ntoni ukuba umkhandi we-Baidu akaphumeleli ukugaqa amakhonkco oxilongo?
Ukuba ukuxilongwa kwe-Baidu crawler kuyasilela amaxesha amaninzi, i-firewall inokuba ivalele inkqubo yesikhasi.
I-Baidu Search Resource Platform > Crawl Diagnosis > Crawl Exceptions Information: Iimpazamo zokufunda nokubhala kwisokethi ▼
- Ngokukodwa xa usebenzisa i-Cloudflare CDN, ivaliwe ngokungagqibekanga.
- Kwi-Intanethi, kuthiwa yongeza idilesi ye-IP
xxx.xxx.xxx.xxx/24 - Nangona kunjalo, oko akuzange kuncede nto.
Khange ndivimbe izigcawu ze-Baidu kumncedisi, ngoko ke ingxaki kufuneka ibe yi-WAF ye-Cloudflare!
Ngena kwi-Cloudflare → Ukhuseleko → WAF → iMithetho yeFirewall → Yenza uMthetho weFirewall
- Fumana imithetho ye-WAF enxulumene nabarhubululi kwi-Cloudflare, kwaye ufumene ukhetho "lomkhandi werobhothi osemthethweni" ▼
- Emva kokudala imithetho ye-firewall, linda imizuzu eyi-10, uze ubambe ukuxilongwa, kwaye bonke babanjwe ngempumelelo!
Yintoni engalunganga ngokusilela kokurhubuluza kwemephu yesayithi ye-Baidu kunye nexesha lokuphuma koqhagamshelwano?
Ukuba ungenisa idilesi yefayile yeSitemap kwiqonga lokukhangela leBaidu, kuya kubakho iingxaki ezinjengokusilela kokurhubuluza kunye nokuphuma koqhakamshelwano ▼
Isisombululo kukusilela kwe-Baidu crawler ukubamba imaphu yeSitemap
Ngena kwi-Cloudflare → Ukhuseleko → WAF → IMithetho yeFirewall → Yenza iMithetho yoMlilo ▼
- indawo, khetha "Ummeli woMsebenzisi"
- umsebenzisi, khetha Kukho
- Yongeza iarhente yomsebenzisi omtsha, cofa okokugqibela "Okanye"
- Ixabiso, ngokulandelelana ngenisa oku kulandelayo umenzeli womsebenzisi we-Baidu Spider UA:
-
Baiduspider/2.0 -
Baiduspider-image -
Baiduspider-render/2.0 -
http://www.baidu.com/search/spider.html -
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) -
Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html）
Emva kokugqiba, vavanya ukulandwa kwakhona, kwaye isiphumo sibuyisela i-HTTP header 200, ebonisa ukuba ukulanda kuphumelele▼
-
抓取诊断 > 抓取详情以下是百度Spider抓取结果及页面信息： -
提交网址： https://www.etufo.org/sitemap_baidu.xml -
抓取网址： https://www.etufo.org/sitemap_baidu.xml -
抓取UA： Mozilla/5.0 (compatible; Baiduspider/2.0; -
+http://www.baidu.com/search/spider.html) -
抓取时间： 2022-11-11 19:03:44 -
网站IP： 172.***.***.149 -
下载时长： 0.868秒 -
返回HTTP头：HTTP/2 200
Abasebenzisi bezinye izigcawu kunye nabarhubuluzi nabo banokuzikhangela kwangohlobo olufanayo.
Ndiyathemba Chen Weiliang Blog ( https://www.chenweiliang.com/ ) kwabelwana "Baidu Spider Crawl Failure Diagnosis Information Abnormal What to do if Socket Read and Write I Error Connection Timeed Out", eluncedo kuwe.
Wamkelekile ukwabelana ngekhonkco leli nqaku:https://www.chenweiliang.com/cwl-29315.html
Wamkelekile kwisitishi seTelegram sebhlog kaChen Weiliang ukufumana uhlaziyo lwamva nje!
📚 Esi sikhokelo sinexabiso elikhulu, 🌟Eli lithuba elinqabileyo, ungaliphoswa! ⏰⌛💨
Yabelana kwaye uthanda ukuba uyathanda!
Ukwabelana kwakho kunye nezinto ozithandayo ziyinkuthazo yethu eqhubekayo!