Analyze AI crawlers
AI Audit metrics provides you with key insights on how AI crawlers are interacting with your website.
To analyze AI crawlers:
- Log in to the Cloudflare dashboard ↗, and select your account and domain.
- Go to AI Audit.
- Go to the Metrics tab.
AI Audit provides you with the following metrics to help you understand how AI crawlers are interacting with your website.
Metric | Description |
---|---|
Total requests | The total number of requests to crawl your website, from all AI crawlers |
Allowed requests | The number of requests you have allowed (by allowing AI crawlers) |
Blocked requests | The number of requests you have blocked (by blocking AI crawlers) |
Requests by AI crawlers | A graph which displays the number of crawl requests from each AI crawler |
Most popular paths by AI crawlers | The most popular pages crawled by AI crawlers, for each AI crawler |
Hosts | Top five most requested hosts (website domains) |
Paths | Top five most requested paths |
AI crawler operators | Top five most active AI crawler operators (by requests) |
You can use the date filter to choose the period of time you wish to analyze.
Filter options:
- Past 24 hours
Filter options:
- Past 24 hours
- Past 7 days
- Past 14 days
- Past month
The values of the AI Audit metrics will update according to your filter.
Was this helpful?
- Resources
- API
- New to Cloudflare?
- Products
- Sponsorships
- Open Source
- Support
- Help Center
- System Status
- Compliance
- GDPR
- Company
- cloudflare.com
- Our team
- Careers
- 2025 Cloudflare, Inc.
- Privacy Policy
- Terms of Use
- Report Security Issues
- Trademark