RULE(RULE ID:333708)

Rule General Information
Release Date: 2021-06-29
Rule Name: Detect ByteDance-Bytespider Web Crawler
Severity:
CVE ID:
Rule Protection Details
Description: A Web crawler is an Internet bot which systematically browsers the World Wide Web, typically for the purpose of Web indexing. Other terms for Web crawlers are ants, automatic indexers, or Web spiders. This rule tries to detect the Web crawlers by inspecting HTTP request header named User-Agent, and prevents information leakage of web site and performance impacts to web site. This rule supports to defend the A2: Broken Authentication of OWASP Top 10 - 2017.
Impact: Private computer resources were used for illegal benefits.
Affected OS: Windows, Linux, Others
Reference:
Solutions
Please contact the software vendor to update the software patch.