robots – Page 2 – The unofficial WordPress Plugin Directory

Crawler Record

Crawler Record tells you the last time each of the most common search/chat bots visited (Google, ChatGPT, etc)- and the pages at which they looked.

Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

Force 410 HTTP Status on listed pages, or just articles/pages that no longer exist.

Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.

Disables the robots meta tag added by WordPress.

Easily create, edit, and manage your site's robots.txt file directly from the WordPress admin panel.

An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

Shows a warning in the WordPress administration header when the option "Search Engine Visibility: Discourage search engines from indexing this si …

Blocks the archive.org bots through the WordPress virtual robots.txt file.