WordPress.org

Dhivehi

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawler

Plugin Tag: crawler

  • Trackbase Analytics

    (0 total ratings)

    Official Trackbase Analytics plugin for WordPress. Add your tracking ID and enable server-side crawler analytics in minutes.

    trackbase 10+ active installations Tested with 7.0.4

  • GlobeSign Content Markdown Mirror

    (0 total ratings)

    Makes your WordPress site AI-friendly: generates llms.txt and clean, structured Markdown mirrors of every page and post.

    globesign 10+ active installations Tested with 7.0.4

  • Boring Cache Warmup Lite

    (2 total ratings)

    A lightweight, privacy-friendly WordPress cache warmup tool. No external services, no drama.

    chriskubisch 10+ active installations Tested with 7.1

  • Crawl Hunt – Advanced SEO Optimization Tool

    (1 total ratings)

    A powerful website crawler and monitoring tool for WordPress.

    themeshopy 10+ active installations Tested with 7.0.4

  • SEObot Monitor for Googlebot, Bingbot and search engine spiders

    (0 total ratings)

    With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …

    Santiago Alonso 10+ active installations Tested with 5.8.15

  • Page Modified

    (1 total ratings)

    Display the results of your Page Modified crawls right within your WordPress Admin.

    Chris Klosowski 10+ active installations Tested with 4.9.31

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    bettoadami 10+ active installations Tested with 5.0.27

  • GoVISIBLE AI Bot Tracker

    (0 total ratings)

    Track visits from AI bots like ChatGPT, GPTBot, Claude, Gemini, and Perplexity.

    GoVISIBLE 10+ active installations Tested with 7.0.4

  • GoBookMart Robots Editor

    (1 total ratings)

    A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.

    Gobookmart 10+ active installations Tested with 6.9.7

  • JaspreetChahal’s wordpress bot detector lite

    (1 total ratings)

    This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …

    Jaspreet Chahal 10+ active installations Tested with 4.2.39

  • AI Crawler Guard

    (0 total ratings)

    Detect and control AI crawler access with local logging and history.

    aicrawlerguard.com Fewer than 10 active installations Tested with 6.9.7

  • ADG Markdown for AI Crawlers

    (0 total ratings)

    Serve AI crawlers clean Markdown of your content on the same URL, and auto-generate a virtual llms.txt / llms-full.txt. No external services.

    A-Devgroup.com Fewer than 10 active installations Tested with 7.1

  • Virtual LLMS.TXT Generator

    (0 total ratings)

    Publish a safe, configurable llms.txt map from public WordPress content, with an opt-in bounded full-text export.

    Alex Oreshkin Fewer than 10 active installations Tested with 7.1

  • Promium AI GEO

    (0 total ratings)

    Write a dedicated version of any post or page for AI crawlers such as GPTBot, ClaudeBot and PerplexityBot, and choose which bots may read it.

    PROMIUM Fewer than 10 active installations Tested with 7.1

  • BotObservatory – Live Bot Tracker & Anti-Scraper

    (1 total ratings)

    Observe human and machine traffic, identify suspicious automation, and optionally quarantine aggressive scrapers.

    traveliaq Fewer than 10 active installations Tested with 7.1

  • URLs Most Wanted for LiteSpeed LScache

    (0 total ratings)

    A demand-driven sitemap for LiteSpeed Cache warmup. Record the URLs visitors actually use and warm only what people need.

    imedes Fewer than 10 active installations Tested with 7.1

  • Pixellize Site Issue Scanner

    (2 total ratings)

    Powerful SEO auditor by Pixellize. Crawls your site to fix broken links, missing meta tags, and unoptimized images.

    Pixellize Fewer than 10 active installations Tested with 7.1

  • Imedes AI Bot Verify

    (0 total ratings)

    Verify supported AI bot identities, allow legitimate agents, and block spoofed claims.

    imedes Fewer than 10 active installations Tested with 7.1

  • Whizz MD — Markdown Endpoints for AI Crawlers

    (0 total ratings)

    Serve every WordPress post and page as a clean .md file with full SEO frontmatter — discoverable by AI crawlers and search engines on the fly.

    Whizz People Fewer than 10 active installations Tested with 7.0.4

  • WEO LLMS & AI Crawler Guide

    (2 total ratings)

    The professional architect for your llms.txt file. Control how AI agents (ChatGPT, Claude, Perplexity) consume your website content with a structured, …

    Md Atiar Rahman Ovi Fewer than 10 active installations Tested with 6.9.7