Description
LLMs.txt – AI Website Content Crawling helps you generate a custom llms.txt file to control how AI language models (LLMs) and search engines crawl your site content.
Key Features
- Automatically generate a valid
llms.txtfile. - Choose which post types are included for AI access.
- Compatible with SEO and privacy-conscious setups.
- Easy to use with minimal configuration.
This plugin is ideal for publishers, bloggers, and businesses looking to control their content visibility to AI systems and bots.
Installation
- Upload the plugin folder to the
/wp-content/plugins/directory. - Activate the plugin through the ‘Plugins’ menu in WordPress.
- Go to Settings > LLMs.txt to configure which post types to include.
- Visit
https://yoursite.com/llms.txtto see the output.
FAQ
-
What is `llms.txt`?
-
It is a proposed standard for signaling content access preferences to large language models and AI crawlers, similar to
robots.txt. -
Does this replace `robots.txt`?
-
No.
llms.txtcomplementsrobots.txtand focuses specifically on AI crawling policies. -
Can I control which content types are included?
-
Yes, the plugin allows you to select which post types (e.g., posts, pages, custom types) should be listed.
Reviews
There are no reviews for this plugin.
Contributors & Developers
“LLMs.txt – AI Website Content Crawling” is open source software. The following people have contributed to this plugin.
Contributors
Translate “LLMs.txt – AI Website Content Crawling” into your language.
Interested in development?
Browse the code, check out the SVN repository, or subscribe to the development log by RSS.
Changelog
1.0
- Initial release.