protection
French 
CrawlTrack, webmaster dashboard.
Web analytic, SEO and protection

CrawlProtect, your website safety.
Reinforced protection

Two php/MySQL scripts, free and easy to install
The tools you need to manage and keep control of your site.





diable

CrawlTrack and CrawlProtect support forum

You are not logged in.


#1 13-07-2010 16:15:48

MindlessGenius
Membre
Registered: 21-04-2009
Posts: 13

Harvester and spambots User Agents not part of htaccess

Bonjour Jean Denis,

During my personal analysis of the user agents blocked by crawlprotect I found a few I know of that are missing in the list...

Just in case some may be missing them as well...

Here they are:

GetRight download manager      
http://www.getright.com
GetRight
GetRight/3.x.x
GetRight/4.5xx 
GetRight/4.x 
GetRight/4.x[a-e] 
GetRight/6.1 (Pro) 
GetRightPro/6.0beta2 
MyGetRight/1.0.0 
MyGetRight/1.0b 

GetWeb - web page to email service
http://www.healthnet.org/getweb.php
GetWeb!
GetWeb/0.1 libwww-perl/5.16

JOC Web Spider        
http://www.jocsoft.com/jws/index.htm
JOC\ Web\ Spider


Pavuk web downloading program for Unix
http://www.idata.sk/%7Eondrej/pavuk/about.html
pavuk
pavuk/0.9pl29b i686-pc-linux-gnu


WebStripper download manager
http://webstripper.net/index.html
http://www.netidea.it/
WebStripper

WebZip offline browser
http://www.spidersoft.com/
WebZIP


WWWoffle download manager
http://www.gedanken.demon.co.uk/wwwoffle/
WWWOFFLE

Here is a few more confirmed spambots  (13 July 2010 12:04)

Some spam bot from Jasmine Internet - Bangkok
http://www.projecthoneypot.org/ip_inspector.php?iph=7bc2eae614063a45b0e1d0786dbe6a2e(203.147.0.xx) 
Link
Mizzu Labs 2.2
s. link


Internet Direct Library for Borland (often used as e-mail address collector and mass mailing tool)
http://forge.novell.com/modules/xfmod/project/?indy-net
http://www.indyproject.org/
Mozilla.*Indy


Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt; DTS Agent
Beijing Express Email Address Extractor via DHCP Data Transport Services (DTS) 
Notice tracking and app site is closed
http://www.zstools.com/
http://esupport.ca.com/index.html?/public/dto_transportit/infodocs/dto1013.asp
DTS\ Agent

I hope this helps!

Last edited by MindlessGenius (13-07-2010 18:07:06)


Guy Deschênes
http://www.hermes-computers.ca

Offline

 

Board footer

Powered by PunBB
© Copyright 2002–2008 PunBB