CrawlTrack, webmaster dashboard.
Web analytic, SEO and protection

CrawlProtect, your website safety.
Reinforced protection

Two php/MySQL scripts, free and easy to install
The tools you need to manage and keep control of your site.


CrawlTrack and CrawlProtect support forum

You are not logged in.

#1 19-06-2011 02:44:39

Nouveau membre
Registered: 17-06-2011
Posts: 5

familiar bots are being blocked as hack attempts

I say familiar as in familiar names. I can only speculate that they are crawling in ways that goes against htaccess rules. Here are a few examples:

User-Agent: LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 -,

Mozilla/5.0 (compatible; discobot/1.1; +xxxx:// -

and "" which whois's to baidu Japan

Not that I care about these spiders being blocked but I was just wondering why they are being blocked. They have been classified as one of these hack attempt types - 113, Badbots and site copier visits - OR - 18, Shell type hacking attempts

Just curious, Thanks a bunch for the script, Doug Wilson



Board footer

Powered by PunBB
© Copyright 2002–2008 PunBB