robot完全禁止一搜YisouSpider爬取网站网页

完全禁止一搜YisouSpider爬取网站网页

https://boke112.com/3672.html

User-agent: YisouSpider  

Disallow: /

User-agent: AhrefsBot

Disallow: /

User-agent: DotBot

Disallow: /

User-agent: DotBot

Disallow: /

发表评论

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen: