protection
French 
CrawlTrack, webmaster dashboard.
Web analytic, SEO and protection

CrawlProtect, your website safety.
Reinforced protection

Two php/MySQL scripts, free and easy to install
The tools you need to manage and keep control of your site.





diable

CrawlTrack and CrawlProtect support forum

You are not logged in.


#1 19-06-2011 02:44:39

dgswilson
Nouveau membre
Registered: 17-06-2011
Posts: 5

familiar bots are being blocked as hack attempts

I say familiar as in familiar names. I can only speculate that they are crawling in ways that goes against htaccess rules. Here are a few examples:

User-Agent: LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 - 69.28.149.32,    216.52.242.14

Mozilla/5.0 (compatible; discobot/1.1; +xxxx://discoveryengine.com/discobot.html) - 38.101.148.126

and "119.63.196.5" which whois's to baidu Japan

Not that I care about these spiders being blocked but I was just wondering why they are being blocked. They have been classified as one of these hack attempt types - 113, Badbots and site copier visits - OR - 18, Shell type hacking attempts

Just curious, Thanks a bunch for the script, Doug Wilson

Offline

 

Board footer

Powered by PunBB
© Copyright 2002–2008 PunBB