BotGate – AI Crawler Control

Protect your website from AI scraping by adding opt-out instructions to your robots.txt file and including meta tags in the HTML ``.

Shows a warning in the WordPress administration header when the option "Search Engine Visibility: Discourage search engines from indexing this si …

Easily create, edit, and manage your site's robots.txt file directly from the WordPress admin panel.

Plugin to edit robots.txt file

Control how AI uses your content — search, AI answers or training — via robots.txt Content Signals, HTTP headers, meta tags and TDMRep.

Track crawlers, scrapers, LLM assistants, and AI agents on your website. Generate a robots.txt that blocks AI bots. Formerly Dark Visitors.