Tusaha Maqaalka
Baidu Spider wuxuu qabtaa macluumaadka ka reeban ogaanshaha: Maxaan sameeyaa haddii godku si khaldan wax u akhriyo oo u qoro?
Adiga oo u maleynaya in shabakadaada aysan ku darin Baidu, waa inaad marka hore ku samaysaa ogaanshaha gurguurta caarada goobta agabka raadinta Baidu.
Maxaan sameeyaa haddii gurguurta Baidu ku guuldareysto inuu gurguurto xiriiriyeyaasha ogaanshaha?
Haddii baaritaanka gurguurta Baidu uu ku guuldareysto dhowr jeer, dab-damiska ayaa laga yaabaa inuu xannibay barnaamijka gurguurta.
Qalabka Ilaha Raadinta Baidu > Baadhista Gurguurashada> Macluumaadka Ka Reebka Gurguurashada: Qaladaadka akhriska iyo qorista godka ▼
- Gaar ahaan marka la isticmaalayo Cloudflare CDN, waa la xannibay si caadi ah.
- Internetka, waxaa la sheegay in lagu daro cinwaanka IP-ga
xxx.xxx.xxx.xxx/24 - Si kastaba ha ahaatee, isku dayay in aan faa'iido lahayn.
Maan xannibin Baidu caarada serferka, markaa dhibaatadu waa inay noqotaa WAF Cloudflare!
Soo gal Cloudflare → Ammaanka → WAF → Xeerarka Dab-damiska → Samee Xeerka Dab-damiska
- Ka hel xeerarka WAF ee la xidhiidha gurguurta Cloudflare, oo waxaad heshay ikhtiyaarka "robot gurguurta oo sharci ah" ▼
- Kadib abuurista xeerarka dab-damiska, sug 10 daqiiqo, ka dibna qabso ogaanshaha, dhammaantoodna si guul leh ayaa loo qabtay!
Maxaa ka qaldan Baidu gurguurta ee Khariidadda Shabkada gurguurashada oo guul daraystay iyo xidhiidhinta wakhtiga dhammaatay?
Haddii aad soo gudbiso ciwaanka galka khariidadda bogga goobta kheyraadka raadinta ee Baidu, waxaa jiri doona dhibaatooyin ay ka mid yihiin gurguurta gurguurta iyo wakhtiga ku xidhidhku ▼
Xalka guul darada Baidu gurguurta si uu u qabsado khariidadda goobta
Soo gal Cloudflare → Ammaanka → WAF → Xeerarka Dab-damiska → Samee Xeerarka Dab-damiska ▼
- goobta, dooro "Agent User"
- hawlwadeen, dooro Contains
- Ku dar wakiilka cusub, dhagsii "ama" u dambeeya
- Qiimaha, siday u kala horreeyaan u geli wakiilka isticmaalaha Baidu Spider UA ee soo socda:
-
Baiduspider/2.0 -
Baiduspider-image -
Baiduspider-render/2.0 -
http://www.baidu.com/search/spider.html -
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) -
Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html）
Dhammaystirka ka dib, tijaabi mar kale, natiijaduna waxay soo celinaysaa HTTP header 200, taasoo tusinaysa in keenista lagu guulaystay▼
-
抓取诊断 > 抓取详情以下是百度Spider抓取结果及页面信息： -
提交网址： https://www.etufo.org/sitemap_baidu.xml -
抓取网址： https://www.etufo.org/sitemap_baidu.xml -
抓取UA： Mozilla/5.0 (compatible; Baiduspider/2.0; -
+http://www.baidu.com/search/spider.html) -
抓取时间： 2022-11-11 19:03:44 -
网站IP： 172.***.***.149 -
下载时长： 0.868秒 -
返回HTTP头：HTTP/2 200
Wakiilada adeegsadaha ee caarada kale iyo gurguurta ayaa sidoo kale naftooda u raadin kara si la mid ah.
Hope Chen Weiliang Blog ( https://www.chenweiliang.com/ ) la wadaagay "Baidu Spider Gurguurato Fashilka Cilad-sheegashada Macluumaadka Aan Caadiga Ahayn Waxa la Sameeyo Haddi Akhriska Socket-ka oo Qoro Cilada Xidhiidhku Wakhtiga Dhamaaday", kaas oo ku anfacaya.
Ku soo dhawoow inaad wadaagto xiriirka maqaalkan:https://www.chenweiliang.com/cwl-29315.html
Ku soo dhawoow kanaalka Telegramka ee Chen Weiliang's blog si aad u hesho wararkii ugu dambeeyay!
📚 Hagahan waxa uu ka kooban yahay qiimo aad u weyn, 🌟Tani waa fursad naadir ah, ha seegin! ⏰⌛💨
Share iyo like saar hadaad jeceshahay!
Wadaagistaada iyo jeceylkaaga ayaa ah dhiirigelintayada joogtada ah!