|
| Description: | | A Web crawler is an Internet bot which systematically browsers the World Wide Web, typically for the purpose of Web indexing. Other terms for Web crawlers are ants, automatic indexers, or Web spiders. This rule tries to detect the Web crawlers by inspecting HTTP request header named User-Agent, and prevents information leakage of web site and performance impacts to web site. This rule supports to defend the A2: Broken Authentication of OWASP Top 10 - 2017. |
|
| Impact: | | Private computer resources were used for illegal benefits. |
|
| Affected OS: | | Network Device, Solaris, FreeBSD, Windows, Mac OS, Other Unix, Linux |
|
| Reference: | | |
|