屏蔽垃圾蜘蛛

查看 42|回复 2
作者:轻功水上漂   
在网上找了下,这个比较全了吧?
(www.seokicks.de|YYSpider|Mattermost|Discord|CCBot|RepoLookoutBot|FBexternalhit|serpstatbot|Pinterestbot|SurdotlyBot|DataForSeoBot|DigExt|HttpClient|MJ12bot|heritrix|EasouSpider|Ezooms|FlightDeckReports|Linguee Bot|Web-Crawler|WellKnownBot|Yellowbrandprotectionbot|ev-crawler|NE Crawler|Facebot|GrapeshotCrawler|SemrushBot|DotBot|MegaIndex.ru|MauiBot|AhrefsBot|MJ12bot|BLEXBot|HubSpot Crawler|CriteoBot|Web-Crawler|web-crawlers|DataForSeoBot|YaK|Mail.RU_Bot|Barkrowler|crawler|SEOkicks-Robot|vxiaotou-spider|telegram|dingtalk|推特bot|DuckDuckGo|applebot|webprosbot|AwarioBot|Amazonbot|AmazonAdBot|YouBot/)
各位大佬还有添加的吗?

大佬, 找了, 屏蔽

jekyll   
DuckDuckGo
youth   
Ahrefs Bot
您需要登录后才可以回帖 登录 | 立即注册

返回顶部