Tusaha Maqaalka
Baidu Spider wuxuu qabtaa macluumaadka ka reeban ogaanshaha: Maxaan sameeyaa haddii godku si khaldan wax u akhriyo oo u qoro?
Adiga oo u maleynaya in shabakadaada aysan ku darin Baidu, waa inaad marka hore ku samaysaa ogaanshaha gurguurta caarada goobta agabka raadinta Baidu.
Maxaan sameeyaa haddii gurguurta Baidu ku guuldareysto inuu gurguurto xiriiriyeyaasha ogaanshaha?
Haddii baaritaanka gurguurta Baidu uu ku guuldareysto dhowr jeer, dab-damiska ayaa laga yaabaa inuu xannibay barnaamijka gurguurta.
Baidu Resource Platform > Baaritaanka Gurguurashada > Macluumaadka Khaladka Gurguurashada: Khaladka Akhrinta/Qoritaanka godka ▼
- Gaar ahaan isticmaalkaCloudflare Marka la isticmaalayo CDN, waxaa lagu xannibaa si caadi ah.
- Internetka, waxaa la sheegay in lagu daro cinwaanka IP-ga
xxx.xxx.xxx.xxx/24 - Si kastaba ha ahaatee, isku dayay in aan faa'iido lahayn.
Maan xannibin Baidu caarada serferka, markaa dhibaatadu waa inay noqotaa WAF Cloudflare!
Soo gal Cloudflare → Ammaanka → WAF → Xeerarka Dab-damiska → Samee Xeerka Dab-damiska
- Ka hel xeerarka WAF ee la xidhiidha gurguurta Cloudflare, oo waxaad heshay ikhtiyaarka "robot gurguurta oo sharci ah" ▼
- Kadib abuurista xeerarka dab-damiska, sug 10 daqiiqo, ka dibna qabso ogaanshaha, dhammaantoodna si guul leh ayaa loo qabtay!
Maxaa ka qaldan Baidu gurguurta ee Khariidadda Shabkada gurguurashada oo guul daraystay iyo xidhiidhinta wakhtiga dhammaatay?
Haddii aad soo gudbiso ciwaanka galka khariidadda bogga goobta kheyraadka raadinta ee Baidu, waxaa jiri doona dhibaatooyin ay ka mid yihiin gurguurta gurguurta iyo wakhtiga ku xidhidhku ▼
Xalka guul darada Baidu gurguurta si uu u qabsado khariidadda goobta
Soo gal Cloudflare → Ammaanka → WAF → Xeerarka Dab-damiska → Samee Xeerarka Dab-damiska ▼
- goobta, dooro "Agent User"
- hawlwadeen, dooro Contains
- Ku dar wakiilka cusub, dhagsii "ama" u dambeeya
- Qiimaha, siday u kala horreeyaan u geli wakiilka isticmaalaha Baidu Spider UA ee soo socda:
-
Baiduspider/2.0 -
Baiduspider-image -
Baiduspider-render/2.0 -
http://www.baidu.com/search/spider.html -
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) -
Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html）
Dhammaystirka ka dib, tijaabi mar kale, natiijaduna waxay soo celinaysaa HTTP header 200, taasoo tusinaysa in keenista lagu guulaystay▼
-
抓取诊断 > 抓取详情以下是百度Spider抓取结果及页面信息： -
提交网址： https://www.etufo.org/sitemap_baidu.xml -
抓取网址： https://www.etufo.org/sitemap_baidu.xml -
抓取UA： Mozilla/5.0 (compatible; Baiduspider/2.0; -
+http://www.baidu.com/search/spider.html) -
抓取时间： 2022-11-11 19:03:44 -
网站IP： 172.***.***.149 -
下载时长： 0.868秒 -
返回HTTP头：HTTP/2 200
Wakiilada adeegsadaha ee caarada kale iyo gurguurta ayaa sidoo kale naftooda u raadin kara si la mid ah.
Waxaan rajeyneynaa in maqaalka "Sida Loola Tacaalo Khaladaadka Akhrinta/Qoritaanka Socket-ka iyo Waqtiyada Xidhiidhka" ee lagu wadaagay baloogga Chen Weiliang ( https://www.chenweiliang.com/ ) uu ku anfici doono.
Xor ayaad u tahay inaad la wadaagto xiriirkan maqaalka: https://www.chenweiliang.com/cwl-29315.html