access_crawler:Sensis Web Crawler(Rule ID:1060210025)
Release Date:2025/9/15
Rule Name:Detect Sensis Web Crawler Web Crawler
Severity:low
CVE ID:
Descripiton:
A Web crawler is an Internet bot which systematically browsers the World Wide Web, typically for the purpose of Web indexing. Other terms for Web crawlers are ants, automatic indexers, or Web spiders. This rule tries to detect the Web crawlers by inspecting HTTP request header named User-Agent, and prevents information leakage of web site and performance impacts to web site. This rule supports to defend the A7: Identification and Authentication Failures of OWASP Top 10 - 2021. Other reference:None