WordPress.org

മലയാളം

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawlers

Plugin Tag: crawlers

  • Block AI Crawlers

    (8 total ratings)

    Adds robots.txt rules blocking AI crawlers and AI bots.

    lastsplash (a11n) 1,000+ active installations Tested with 7.1.3

  • Robots.txt rewrite

    (2 total ratings)

    Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

    Eugen Bobrowski 1,000+ active installations Tested with 4.7.38

  • AI Content Signals

    (3 total ratings)

    Control how AI uses your content — search, AI answers or training — via robots.txt Content Signals, HTTP headers, meta tags and TDMRep.

    Fernando Tellado 800+ active installations Tested with 7.1.3

  • CodingBunny LLMs.txt Generator

    (1 total ratings)

    Advanced llms.txt generator with AI metadata, Schema.org types, canonical URLs, and differentiated licenses for optimal LLM indexing.

    CodingBunny 100+ active installations Tested with 7.1.3

  • Robots Meta Whiz

    (0 total ratings)

    Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.

    Marat Nepomnyashy 100+ active installations Tested with 4.7.38

  • MetaRobots by SEO-Sign

    (1 total ratings)

    The easiest way to manage meta robots tag.

    Artem Pilipets 100+ active installations Tested with 4.1.42

  • Serve Markdown

    (0 total ratings)

    Serve Markdown versions of your posts and pages to AI agents and crawlers. Content negotiation, .md URLs, auto-discovery, and crawler logging.

    Azey 80+ active installations Tested with 6.9.10

  • ParseLess

    (0 total ratings)

    Serve AI the good version of your content, see which bots really read it, and cap what they cost you. Markdown for crawlers and agents — 95%+ less ban …

    phalkmin 70+ active installations Tested with 7.0.7

  • CeeWP Robots.txt Manager

    (0 total ratings)

    Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!

    CeeWP 40+ active installations Tested with 6.8.11

  • Log-Hero.com Plugin

    (2 total ratings)

    See which search engines, AI crawlers and other bots visit your site, and what they find. The official plugin for log-hero.com.

    Log Hero 40+ active installations Tested with 7.1.3

  • Seo Crawlytics Data Export & Delete

    (0 total ratings)

    Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.

    apasionados 20+ active installations Tested with 6.3.13

  • Temso AI

    (0 total ratings)

    Stream front-end request logs from your WordPress origin to Temso so AI-crawler and bot traffic shows up in your dashboard.

    Temso AI 10+ active installations Tested with 7.1.3

  • LJPL Armored robots.txt

    (0 total ratings)

    Add some directives to your robots.txt file to keep your site safer

    Lukasz Jasinski 10+ active installations Tested with 3.4.2

  • MSG LLMs TXT Manager

    (0 total ratings)

    Serve your content as clean Markdown to AI agents, publish llms.txt and llms-full.txt, and see which agents actually fetch what.

    Hugo 10+ active installations Tested with 7.1.3

  • PufferSights – AI Crawler Insights

    (0 total ratings)

    Monitor 135+ known AI crawlers and agents with local analytics, AI referrals, llms.txt, and opt-in robots.txt policy tools.

    senols 10+ active installations Tested with 7.1.3

  • Supertab Connect

    (2 total ratings)

    Connect your WordPress site to the Supertab Connect platform for RSL license serving and enabling crawler authentication protocol.

    getsupertab Fewer than 10 active installations Tested with 7.0.7

  • PinMeOut

    (0 total ratings)

    Control which AI crawlers may read your site, see which ones actually do, and make your pages worth citing. Works alongside your SEO plugin.

    tothiq Fewer than 10 active installations Tested with 7.1.3

  • Clownsteins Rogue Agent Defender

    (0 total ratings)

    Protects the site from external AI attacks by blocking inference providers and selected crawlers.

    Albert Fewer than 10 active installations Tested with 7.1.3

  • Misha Manko AI Bot Access Checker

    (0 total ratings)

    See which AI bots can reach your site – ChatGPT, Claude, Perplexity, Google AI and more – and why the others are blocked.

    mishamanko Fewer than 10 active installations Tested with 7.1.3

  • AI Rights Protection by SimpleFeed

    (1 total ratings)

    Protect your rights by reviewing and blocking AI bots from using your content without compensation.

    Alex Khomichenko Fewer than 10 active installations Tested with 6.7.10