Title: Plugins categorized as crawler | WordPress.org Dhivehi --- Search * [All](https://dv.wordpress.org/plugins/) * [Community](https://dv.wordpress.org/plugins/tags/crawler/?plugin_business_model=community) * [Commercial](https://dv.wordpress.org/plugins/tags/crawler/?plugin_business_model=commercial) # Plugin Tag: crawler * ![](https://ps.w.org/email-address-encoder/assets/icon-256x256.jpg?rev=970206) * ### 󠀁[Email Address Encoder](https://dv.wordpress.org/plugins/email-address-encoder/)󠁿 * (160 total ratings) * A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities. * Till Krüss 100,000+ active installations Tested with 7.0 * ![](https://ps.w.org/robots-txt-editor/assets/icon-256x256.jpg?rev=2081244) * ### 󠀁[Robots.txt Editor](https://dv.wordpress.org/plugins/robots-txt-editor/)󠁿 * (8 total ratings) * Robots.txt for WordPress * Processby 10,000+ active installations Tested with 5.6.17 * ![](https://ps.w.org/no-bot-registration/assets/icon-256x256.jpg?rev=3113674) * ### 󠀁[No-Bot Registration](https://dv.wordpress.org/plugins/no-bot-registration/)󠁿 * (27 total ratings) * Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question. * Arnan 2,000+ active installations Tested with 6.9.4 * ![](https://ps.w.org/robotstxt-rewrite/assets/icon-128x128.png?rev=1409259) * ### 󠀁[Robots.txt rewrite](https://dv.wordpress.org/plugins/robotstxt-rewrite/)󠁿 * (2 total ratings) * Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too. * Eugen Bobrowski 1,000+ active installations Tested with 4.7.33 * ![](https://ps.w.org/marquee-image-crawler/assets/icon-256x256.png?rev=2445778) * ### 󠀁[Marquee image crawler](https://dv.wordpress.org/plugins/marquee-image-crawler/)󠁿 * (1 total ratings) * Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right. * gopiplus 700+ active installations Tested with 6.1.10 * ![](https://ps.w.org/mass-ping-tool-for-seo/assets/icon-256x256.jpg?rev=2741945) * ### 󠀁[Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …](https://dv.wordpress.org/plugins/mass-ping-tool-for-seo/)󠁿 * (4 total ratings) * Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in … * Pagup 500+ active installations Tested with 7.0 * ![](https://ps.w.org/db-robotstxt/assets/icon.svg?rev=2956961) * ### 󠀁[Bisteinoff SEO Robots.txt](https://dv.wordpress.org/plugins/db-robotstxt/)󠁿 * (4 total ratings) * An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO). * Denis Bisteinov 500+ active installations Tested with 6.9.4 * ![](https://ps.w.org/block-archive-org-robots-txt/assets/icon-256x256.jpg?rev =1922069) * ### 󠀁[Block Archive.org via WordPress robots.txt](https://dv.wordpress.org/plugins/block-archive-org-robots-txt/)󠁿 * (0 total ratings) * Blocks the archive.org bots through the WordPress virtual robots.txt file. * apasionados 400+ active installations Tested with 6.9.4 * ![](https://ps.w.org/block-chat-gpt-via-robots-txt/assets/icon-256x256.jpg?rev =2893474) * ### 󠀁[Block Chat GPT via robots.txt](https://dv.wordpress.org/plugins/block-chat-gpt-via-robots-txt/)󠁿 * (1 total ratings) * Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file * apasionados 100+ active installations Tested with 6.3.8 * ![](https://s.w.org/plugins/geopattern-icon/bodi0s-bots-visits-counter_f2f7f9. svg) * ### 󠀁[bodi0`s Bots visits counter](https://dv.wordpress.org/plugins/bodi0s-bots-visits-counter/)󠁿 * (5 total ratings) * Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings. * Budiony Damyanov 100+ active installations Tested with 6.1.10 * ![](https://ps.w.org/block-ecommerce-assets-via-robots-txt/assets/icon-256x256. jpg?rev=2370844) * ### 󠀁[Block eCommerce Assets via robots.txt](https://dv.wordpress.org/plugins/block-ecommerce-assets-via-robots-txt/)󠁿 * (0 total ratings) * Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt * apasionados 100+ active installations Tested with 6.3.8 * ![](https://ps.w.org/warmer/assets/icon.svg?rev=3547070) * ### 󠀁[Warmer – Cache Warmer and Cache Preload Crawler](https://dv.wordpress.org/plugins/warmer/)󠁿 * (6 total ratings) * Warm your WordPress cache with scheduled crawling, cache preloading, URL source control, logs, diagnostics, and WP-CLI. * Atakan Oz 70+ active installations Tested with 7.0 * ![](https://ps.w.org/ai-deny/assets/icon-256x256.png?rev=3410148) * ### 󠀁[AI Deny](https://dv.wordpress.org/plugins/ai-deny/)󠁿 * (1 total ratings) * Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay. * Code For Broke 60+ active installations Tested with 6.9.4 * ![](https://ps.w.org/findkit/assets/icon.svg?rev=3011976) * ### 󠀁[Findkit – Site Search](https://dv.wordpress.org/plugins/findkit/)󠁿 * (0 total ratings) * Powerful cloud based search engine for your website. Search as you type, real- time index updates, and embeddable UI. Free for small websites. * Findkit Team 60+ active installations Tested with 6.9.0 * ![](https://ps.w.org/boring-cache-warmup-lite/assets/icon.svg?rev=3563992) * ### 󠀁[Boring Cache Warmup Lite](https://dv.wordpress.org/plugins/boring-cache-warmup-lite/)󠁿 * (2 total ratings) * A lightweight, privacy-friendly WordPress cache warmup tool. No external services, no drama. * chriskubisch 30+ active installations Tested with 7.0 * ![](https://ps.w.org/block-common-crawl-via-robots-txt/assets/icon-256x256.jpg? rev=2915353) * ### 󠀁[Block Common Crawl via robots.txt](https://dv.wordpress.org/plugins/block-common-crawl-via-robots-txt/)󠁿 * (0 total ratings) * Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file * apasionados 30+ active installations Tested with 6.3.8 * ![](https://ps.w.org/block-feed-and-comments-via-robots-txt/assets/icon-256x256. jpg?rev=2371412) * ### 󠀁[Block Feed and Comments via robots.txt](https://dv.wordpress.org/plugins/block-feed-and-comments-via-robots-txt/)󠁿 * (0 total ratings) * Blocks some Feed and Comment resources in order to avoid spam bots * apasionados 20+ active installations Tested with 6.3.8 * ![](https://ps.w.org/edgeshaping-lite/assets/icon-256x256.png?rev=3577242) * ### 󠀁[EdgeShaping Lite](https://dv.wordpress.org/plugins/edgeshaping-lite/)󠁿 * (0 total ratings) * Observe which AI bots visit which pages and when. WordPress implementation of the EdgeShaping framework. * mareinterno 20+ active installations Tested with 7.0 * ![](https://ps.w.org/azayem-bots-tracker/assets/icon-256x256.png?rev=3427328) * ### 󠀁[Azayem Bots Tracker – Bot Visits Logger](https://dv.wordpress.org/plugins/azayem-bots-tracker/)󠁿 * (0 total ratings) * A custom plugin to log search engine bot visits and analyze their crawl budget directly inside WordPress (no external services required). * botstracker 10+ active installations Tested with 6.9.4 * ![](https://ps.w.org/adriano-geo-context-crawl-monitor/assets/icon-256x256.png? rev=3585846) * ### 󠀁[Adriano GEO Context and Crawl Monitor](https://dv.wordpress.org/plugins/adriano-geo-context-crawl-monitor/)󠁿 * (0 total ratings) * Optimize your WordPress site for AI search engines. Serves a virtual AI context endpoint, injects JSON-LD schema, and tracks AI crawler visits. * adriano 10+ active installations Tested with 7.0 ## Posts pagination 1 [2](https://dv.wordpress.org/plugins/tags/crawler/page/2/?output_format=md) [3](https://dv.wordpress.org/plugins/tags/crawler/page/3/?output_format=md) [Next](https://dv.wordpress.org/plugins/tags/crawler/page/2/?output_format=md)