| Nikto 2.03 | |
| robots.txt entries (if present) Scan multiple ports on a target to find web servers (can integrate nmap for speed, if available) Multiple IDS evasion techni... |  Download now |
| Size: 484KB License: GPL Price: Free By: CIRT, Inc. |
| UrlRewriter.NET 1.6 | |
| robots.txt protocol Ban users based on IP range (provides the capabilities of mod_rewrite on IIS) And much more… UrlRewriter.NET is a pure .NET componen... | Download now |
| Size: 176KB License: Freeware Price: Free By: urlrewriter |
| Get Going Server by Blaiz Enterprises 1.00.1175 | |
| ico' creation * Online Contact Form (subject, name, email address and large message box fields) - send data to specified url * Tick and set 'robots.txt' creatio... | Download now |
| Size: 574KB License: Freeware Price: Free By: Blaiz Enterprises |
| Xenu's Link Sleuth 1.3c | |
| Additional features: robots.txt support Detect remote loading of images (geocities sabotages this) Solution for leftover TGH*.* files in temp directory ... | Download now |
| Size: 405KB License: Freeware Price: Free By: snafu.de |
| Keyword Crawler 1.1 | |
| Keyword Crawler could also calculate word density in pages and display the metas and observes the directives of the robots.txt and 'robot' meta tags. | Download now |
| Size: 0.40MB License: Freeware Price: Free By: webkeysoft |
| Chrome SEO 0.8 | |
| Server Location ● Detects robots.txt and Sitemap.xml Current sources inlcude : Archive.org, Alexa Rank, Compete Rank, CoralCDN, Ask, Baidu, Bing, Delicio... | Download now |
| Size: 406KB License: Freeware Price: Free By: marketingabuse.com |
Hello Engines! Standard 7.2.2  |  Buy now |
| It detects all errors in the HTML code, broken links, errors in the sitemap and robots.txt files etc. In addition, all important ranking factors are checked, so... | Download now |
| Size: 7.64MB License: Commercial Price: EUR99.00 By: AceBIT |
| WebSecrets 2 | |
| they are: /robots.txt /photoalbum/upload/ /_vti_pvt/ :5800/ /phpMyAdmin/ /config.html/ /_private/ Denial Of Service Checking and Exploitation weak... | Download now |
| Size: 18KB License: Freeware Price: Free By: E-Cracker |
| SEOpen 1.1 | |
| robots.txt * Whois Info CrapWare Free! Planned for future versions: * Yahoo & MSN Cache * Spider Simulator and/or Text Browser view * IP-ba... | Download now |
| Size: 11KB License: Freeware Price: Free By: Damian Smith |
| SEO & Website Analysis 0.2.9 | |
| robots.txt - XML Sitemap - Flash - Ajax - Language - Doctype - W3C validity - Google Analytics installed - Google page rank (PR pagerank) - Microformat... | Download now |
| Size: 7KB License: Freeware Price: Free By: WooRank.com |
| RTMenu Sitemap Generator 1.0 | |
| Sitemap generated by sitemap generator is robots.txt compatible. Easy to use sitemap generator for webmasters. One click sitemap generation with many configurab... | Download now |
| Size: 638KB License: Freeware Price: Free By: RTMenu |
| SpidEye 1.0.0 | |
| -robots.txt Analyzes robots.txt in a syntax-highlighted viewer. -File Info Give file information and calculates file hash. If requested, can monitor text mod... | Download now |
| Size: 1.02MB License: Freeware Price: Free By: Software Atelier |
| yExplore 2.1.0 | |
| - View the robots.txt file. - Spell check the current page. - Edit the current page. - Text only view. - Whois Info. | Download now |
| Size: 30KB License: Freeware Price: Free By: twistermc |
| Openfind Enterprise Search 3.0.15 | |
| Support robots.txt Crawling 5. HTTP Basic Authentication 6. Proxy Server Management 7. User Agent Name Management 8. Failed-URL Audit XML Search Manageme... | Download now |
| Size: 20.95MB License: Shareware Price: N/A By: Openfind Information Technology, Inc. |