Crawler Blacklist - These are the list of bots that are being blocked |
| NA | - | Vulnerability Checker, Email Harvester |
| NA | Java/x.x.xx | Home made Sun Java Crawlers |
| RU | Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/) | Email Harvester |
| RU | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322) Babya Discoverer 8.0: | Email Harvester |
| US | .NET Framework Test Client | Email Harvester |
| CN | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) | Vulnerability Checker, Email Harvester |
| KR | core-project/1.0 | Vulnerability Checker, Email Harvester |
| US | Mozilla/4.0 (compatible; MSIE 6.0; Windows 98) | Email Harvester |
| FR | Morfeus Fucking Scanner | Vulnerability Checker |
| RU | Mozilla/4.0+(compatible;+MSIE+4.01;+Windows+95) | Vulnerability Checker |
| CN | Mozilla/3.0+(compatible; Indy Library) | Vulnerability Checker |
| FR | Toata dragostea mea pentru diavola | Email Harvester, Statisitc Harvester, Log Harvester |
| US | DataCha0s/2.0 | Email Harvester |
| CN | Wget/1.10.2 (Red Hat modified) | Virtual Web Server Exploitation |
| LV | webcollage/1.135a | Unknown |
| US | Microsoft URL Control - 6.01.9782 | Email Spammer |
| US | POE-Component-Client-HTTP/0.65 (perl; N; POE; en; rv:0.650000) | Word Research |
| UA | Mozilla/5.0 (compatible; DBLBot/1.0; http://www.dontbuylists.com/) | Unknown |
| TW | Gaisbot/3.0 (robot06@gais.cs.ccu.edu.tw; http://gais.cs.ccu.edu.tw/robot.php) | Educational |
| FR | Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com) | Spambot |
| US | WordPress/2.7 | Spambot |
| BR | NV32ts | SQL Injector |
| US | panscient.com | Vertical Search Engines |
| US | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | Vertical Search Engines |
| US | Get query results | SQL Injector |
| US | Lynx/2.8.5rel.1 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/0.9.8b | Unknown |
| US | Mozilla/4.0 | Unknown |
| US | libwww-perl/5.805 | Educational |
| US | Microsoft URL Control - 6.01.9782 | Unknown |
| UA | Mozilla/5.0 (compatible; DBLBot/1.0; +http://www.dontbuylists.com/) | Email Harvester |