Papa Kuhikuhi ʻatikala
Lawe ʻo Baidu Spider i ka ʻike ʻokoʻa diagnostic: He aha kaʻu e hana ai inā heluhelu a kākau pololei ke kumu?
Ke manaʻo nei ʻaʻole i hoʻokomo ʻia kāu pūnaewele e Baidu, pono ʻoe e hana mua i ka hōʻoia ʻana i ka spider crawling ma ke kahua hulina Baidu.
He aha kaʻu e hana ai inā ʻaʻole hiki ke kolo ʻo Baidu i nā loulou diagnostic?
Inā hāʻule ka ʻike koko koko Baidu i nā manawa he nui, ua pāpā paha ka pā ahi i ka polokalamu kolo.
Papahana Punawai Huli Baidu > Ho'opepepepepepepepepepepepepepepepepepepepepepepepepepepepepepe 'ike 'ike 'oko'a. Helu heluhelu a kākau i ka Socket ▼
- ʻOi loa i ka hoʻohana ʻana iā Cloudflare CDN, ua ālai ʻia e ka paʻamau.
- Ma ka Pūnaewele, ua ʻōlelo ʻia e hoʻohui i ka helu IP
xxx.xxx.xxx.xxx/24 - Akā naʻe, ua hoʻāʻo i kēlā ʻaʻole i loaʻa.
ʻAʻole au i ālai i nā spiders Baidu ma ke kikowaena, no laila ʻo ka WAF o Cloudflare ka pilikia!
E komo i Cloudflare → Palekana → WAF → Nā lula ahi → E hana i ka lula ahi
- E ʻimi i nā lula WAF e pili ana i nā mea kolo ma Cloudflare, a loaʻa ke koho o "lopako kolo kūpono" ▼
- Ma hope o ka hana ʻana i nā lula o ka pā ahi, e kali no 10 mau minuke, a laila hopu i ka maʻi maʻi, a ua hopu ʻia lākou a pau!
He aha ka hewa o Baidu crawler Sitemap e kolo ana i ka hemahema a me ka pau ʻana o ka pilina?
Inā ʻoe e hoʻouna i ka helu wahi o ka waihona Sitemap ma ka paena kumu hulina Baidu, e loaʻa ana nā pilikia e like me ka holo ʻole ʻana a me ka pau ʻana o ka pilina ▼
Hoʻoholo i ka hiki ʻole o Baidu crawler e hopu i ka palapala ʻāina Sitemap
E komo i Cloudflare → Palekana → WAF → Nā lula ahi → E hana i nā lula ahi ▼
- kahua, koho "User Agent"
- mea hoʻohana, koho Loaʻa
- E hoʻohui i kahi mea hoʻohana hou, e kaomi i ka "Or" hope loa
- ʻO ka waiwai, e hoʻokomo i ka mea hoʻohana Baidu Spider UA penei:
-
Baiduspider/2.0 -
Baiduspider-image -
Baiduspider-render/2.0 -
http://www.baidu.com/search/spider.html -
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) -
Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html）
Ma hope o ka pau ʻana, e hoʻāʻo hou i ke kiʻi ʻana, a hoʻihoʻi ka hopena i ke poʻomanaʻo HTTP 200, e hōʻike ana i ka holomua o ke kiʻi ʻana▼
-
抓取诊断 > 抓取详情以下是百度Spider抓取结果及页面信息： -
提交网址： https://www.etufo.org/sitemap_baidu.xml -
抓取网址： https://www.etufo.org/sitemap_baidu.xml -
抓取UA： Mozilla/5.0 (compatible; Baiduspider/2.0; -
+http://www.baidu.com/search/spider.html) -
抓取时间： 2022-11-11 19:03:44 -
网站IP： 172.***.***.149 -
下载时长： 0.868秒 -
返回HTTP头：HTTP/2 200
Hiki i nā mea hoʻohana o nā spiders a me nā mea kolo ke ʻimi iā lākou iho ma ke ʻano like.
Hope Chen Weiliang Blog ( https://www.chenweiliang.com/ ) kaʻana like "Baidu Spider Crawl Failure Diagnosis Abnormal Information He aha ka mea e hana ai inā ua pau ka manawa o ka Socket Read and Write Error Connection", he mea kōkua ia iā ʻoe.
Welina mai e kaʻana like i ka loulou o kēia ʻatikala:https://www.chenweiliang.com/cwl-29315.html
Welina mai i ke kahawai Telegram o ka moʻomanaʻo ʻo Chen Weiliang e kiʻi i nā mea hou loa!
📚 He waiwai nui kēia alakaʻi, 🌟He manawa kakaikahi kēia, mai poina! ⏰⌛💨
Kaʻana like a like inā makemake ʻoe!
ʻO kāu kaʻana like a me kou makemake ʻo kā mākou hoʻoikaika mau!