/ Plugin Category

/ Site Administration & Utilities

/ URL Redirects & 301 Management

/ Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral Traffic

Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral Traffic

By Known Agents

Site Administration & Utilities / URL Redirects & 301 Management

Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral Traffic Review - In-Depth Analysis

Track crawlers, scrapers, and AI agents on your website. Generate a robots.txt to block unwanted bots. Analyze referral traffic from LLMs.

Performance Overview

WPS Score

6.68/10

User Rating

4.8/5 (based on 6+ reviews)

Active Installations

1,000+

Update Frequency

Below Average It is calculated using the weighted average of same category plugins.

Security Score

1 / 10 (Very Low Risk) It is calculated using the weighted average of all versions.

What It Does

Track crawlers, scrapers, and AI agents on your website. Generate a robots.txt that blocks AI bots. Formerly Dark Visitors.

You can protect your content from unwanted AI scraping and turn the rising wave of AI agents and other bots visiting your website into a new growth channel for your business.

Get realtime visibility into the hidden ecosystem of crawlers, scrapers, and AI agents browsing your website. Watch traffic from crawlers and scrapers as it happens and replay AI agent navigation patterns.

Measure citations and human click-throughs from AI chat platforms like ChatGPT and find out which AI platforms are sending you traffic.

This plugin connects your website to Known Agents and uses the Known Agents API to provide functionality.

Other Notable Features

Here are a few other notable features of this free Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral Traffic plugin.

AI agents tracking

crawler analytics

robots.txt management

Screenshots

FAQ

More than you think. On average, 40% or more of website visits come from AI agents and bots, a volume that is completely invisible to traditional analytics tools like Google Analytics. This has been observed consistently across websites of all sizes and industries.

Contributors and developers

“Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral Traffic” is open source software. The following people have contributed to this plugin.