WordPress.org

Kernewek

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawler

Plugin Tag: crawler

  • URLs Most Wanted for LiteSpeed LScache

    (0 total ratings)

    A demand-driven sitemap for LiteSpeed Cache warmup. Record the URLs visitors actually use and warm only what people need.

    imedes Fewer than 10 active installations Tested with 7.1.3

  • AI Crawler Guard

    (0 total ratings)

    Detect and control AI crawler access with local logging and history.

    aicrawlerguard.com Fewer than 10 active installations Tested with 6.9.10

  • Imedes AI Bot Verify

    (0 total ratings)

    Verify supported AI bot identities, allow legitimate agents, and block spoofed claims.

    imedes Fewer than 10 active installations Tested with 7.1.3

  • Virtual LLMS.TXT Generator

    (0 total ratings)

    Publish a safe, configurable llms.txt map from public WordPress content, with an opt-in bounded full-text export.

    Alex Oreshkin Fewer than 10 active installations Tested with 7.1.3

  • Content Heal AI Crawler Protection & Honeypot Shield

    (0 total ratings)

    Block unauthorized AI crawlers from scraping your content and monetize verified bot access.

    piyushsingh14 Fewer than 10 active installations Tested with 7.1.3

  • Trimardeau SEO Log : SEO & GEO Bot Analytics

    (0 total ratings)

    SEO & GEO bot analytics: see Googlebot, ChatGPT, Claude and every AI crawler at work on each post, page and term — full crawl history included.

    Nicolas TRIMARDEAU Fewer than 10 active installations Tested with 7.1.3

  • Pixellize Site Issue Scanner

    (2 total ratings)

    Powerful SEO auditor by Pixellize. Crawls your site to fix broken links, missing meta tags, and unoptimized images.

    Pixellize Fewer than 10 active installations Tested with 7.1.3

  • ddosNull AI Crawler & Scraper Blocker

    (0 total ratings)

    Block GPTBot, ClaudeBot, Bytespider and 170+ AI crawlers and scrapers, bot by bot. Blocks by user agent and robots.txt. Optional daily list updates.

    ddosnull Fewer than 10 active installations Tested with 7.1.3

  • Whizz MD — Markdown Endpoints for AI Crawlers

    (0 total ratings)

    Serve every WordPress post and page as a clean .md file with full SEO frontmatter — discoverable by AI crawlers and search engines on the fly.

    Whizz People Fewer than 10 active installations Tested with 7.0.7

  • Bottoll – AI Crawler Control

    (0 total ratings)

    Detect AI crawlers, apply access policies, and understand automated access to your WordPress content.

    bottoll Fewer than 10 active installations Tested with 7.0.7

  • WEO LLMS & AI Crawler Guide

    (2 total ratings)

    The professional architect for your llms.txt file. Control how AI agents (ChatGPT, Claude, Perplexity) consume your website content with a structured, …

    Md Atiar Rahman Ovi Fewer than 10 active installations Tested with 6.9.10

  • Wizehawk Store Discovery Audit

    (0 total ratings)

    Local-first WooCommerce readiness checks for AI search discovery, crawler access, and structured product information.

    Wizehawk Fewer than 10 active installations Tested with 7.1.3

  • Cleotic AI Traffic

    (0 total ratings)

    See AI crawler visits and AI assistant referrals on your site, with optional signed sync to Cleotic.

    cleotic Fewer than 10 active installations Tested with 7.0.7

  • EZDIGI Tool

    (0 total ratings)

    All-in-one management toolkit for WordPress: site security, bot blocker, crawler, image optimizer, variation fixer, affiliate manager, live streaming …

    EZDIGI Fewer than 10 active installations Tested with 7.1.3

  • OpenBotAuth – AI Crawler Access Control

    (0 total ratings)

    Verify AI crawlers with HTTP Signatures and enforce allow/deny/teaser policies; also serves llms.txt and AI-ready feeds.

    hammadtq Fewer than 10 active installations Tested with 6.9.10

  • AILYS Lens

    (1 total ratings)

    See how AI reads your site. Detects, verifies, and displays AI crawler visits — all data stays on your own server.

    roadleon Fewer than 10 active installations Tested with 7.1.3

  • OtterFixer AI Bot Tracker

    (0 total ratings)

    A lightweight plugin that logs visits from common AI/LLM crawler user-agents and shows a simple report in wp-admin.

    OtterFixer Fewer than 10 active installations Tested with 6.9.10

  • Aiso AI Crawler Analytics

    (0 total ratings)

    See which AI assistants — ChatGPT, Claude, Perplexity, Google and more — crawl your site, broken down by assistant, crawler, purpose and page.

    bentannenbaum Fewer than 10 active installations Tested with 7.0.7