Baidu dandemutande rinokambaira kutadza kuongororwa abnormal information socket verenga nekunyora kukanganisa kubatana nguva yapera zvekuita

Baidu Spider inokambaira uye inoongorora ruzivo rusina kujairika: Chii chandinofanira kuita kana soketi ikaverengwa kana kunyorwa?

Tichifunga kuti webhusaiti yako haina kunyorwa neBaidu, iwe unofanirwa kutanga waita spider kukambaira kuongororwa paBaidu yekutsvaga zviwanikwa papuratifomu.

Chii chandinofanira kuita kana chinokambaira cheBaidu chikatadza kukambaira chinongedzo chekuongorora?

Kana Baidu crawler ikatadza kukambaira nekuongorora kakati wandei, firewall inogona kunge yakavharira chinokambaira.

Baidu Search Resource Platform > Crawling Diagnostics > Ruzivo rweKukanganisa kweKukambaira: Kukanganisa kweKuverenga/Kunyora paSocket ▼

Gadzirisa Baidu dandemutande rinokambaira kutadza kuongororwa kunze kweruzivo socket verenga nekunyora zvikanganiso zvekubatanidza nguva yapera

  • Kunyanya kushandisaCloudflare Kana uchishandisa CDN, inovharwa nedefault.
  • PaInternet, pane kutaura kwekuwedzera IP kero xxx.xxx.xxx.xxx/24
  • Zvisinei, akaedza pasina chimuko.

Ini handisi kuvharira Baidu spider paserver, saka dambudziko rinofanira kunge riri Cloudflare's WAF!

Saina ku Cloudflare → Chengetedzo → WAF → Mitemo yeFirewall → Gadzira Firewall Rule

  • Kutsvaga mitemo yeWAF inoenderana nevanokambaira paCloudflare uye wakawana "Legal Robot Crawler" sarudzo ▼

Pinda muCloudflare → Chengetedzo → WAF → Mitemo yeFirewall → Gadzira Mutemo weFirewall. Ndichitsvaga mitemo yeWAF ine chekuita newebhu crawler paCloudflare, ndakawana sarudzo ye "Legitimate Web Crawler".

    • Mushure mekugadzira mitemo ye firewall, mirira kwemaminitsi gumi, uye wobva wabata chirwere chacho, uye vose vanobudirira kubata!

Baidu crawler Sitemap yatadza kukambaira, connection yapera nguva here?

Kana iyo sitemap faira kero ikatumirwa paBaidu yekutsvaga zviwanikwa papuratifomu, pachave nematambudziko ekukambaira kutadza uye yekubatanidza nguva yekupera ▼

Baidu crawler Sitemap yatadza kukambaira, connection yapera nguva here?

Baidu crawler yatadza kukamba yeSitemap mepu mhinduro

Saina ku Cloudflare → Chengetedzo → WAF → Mitemo yeFirewall → Gadzira Mitemo yeFirewall ▼

Kutadza Kuongororwa kweBaidu Spider Crawling Error Socket Read/Write Error Connection Timeout: Chii Chaunofanira Kuita? - Chen Weiliang Blog_Network Marketing Planning_Cross-border E-commerce Operation Website Promotion Tutorial

  1. munda, sarudza Mushandisi-Mumiriri
  2. opareta, sarudza "ine"
  3. Wedzera mushandisi mutsva, tinya "Kana" kumagumo
  4. kukosha, isa inotevera Baidu Spider UA mushandisi mumiriri zvakateerana:
    • Baiduspider/2.0
    • Baiduspider-image
    • Baiduspider-render/2.0
    • http://www.baidu.com/search/spider.html
    • Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
    • Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

    Mushure mekupedza, edza uye tora zvakare, uye mhedzisiro inodzosa HTTP musoro 200, zvichiratidza kuti kutora kwabudirira▼

    • 抓取诊断 > 抓取详情
      以下是百度Spider抓取结果及页面信息:
    • 提交网址: https://www.etufo.org/sitemap_baidu.xml
    • 抓取网址: https://www.etufo.org/sitemap_baidu.xml
    • 抓取UA: Mozilla/5.0 (compatible; Baiduspider/2.0;
    • +http://www.baidu.com/search/spider.html)
    • 抓取时间: 2022-11-11 19:03:44
    • 网站IP: 172.***.***.149
    • 下载时长: 0.868秒
    • 返回HTTP头:HTTP/2 200

    Vashandisi vemamwe dandemutande nevanokambaira vanogonawo kuzvitsvaga nenzira imwecheteyo.

    发表 评论

    您的邮箱地址不会被公开。必填项已用*标注

    Mupumburu TOP