Create virtual /llm.txt and /llms.txt—Allow All, Per-Bot, or Manual—plus live checker and advanced generator.
Plugin Tag: robots
-
Block Feed and Comments via robots.txt
Blocks some Feed and Comment resources in order to avoid spam bots
-
Block Common Crawl via robots.txt
Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
TDMRep: TDM Reservation Protocol
TDM Reservation Protocol. Control how bots and artificial intelligences like ChatGPT, GoogleBot and Bard access your content.
-
CeeWP Robots.txt Manager
Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
Noindex by Path
Ask search engines not to index individual pages by a relative path – which means you can set every url no matter it is a page, category listing or an …
-
AI Deny
Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
Native SEO NoIndexer
Lightweight SEO noindex and nofollow manager for WordPress. Control which content search engines should not index or follow.
