Plugin Tag: crawler
-
AILYS Lens
(1 total ratings)See how AI reads your site. Detects, verifies, and displays AI crawler visits — all data stays on your own server.
-
ReadyStack Robots Txt AI Crawler Audit
(0 total ratings)Checks robots.txt line by line and says what each AI crawler token actually controls – training, AI-search citation, or user fetch – and which lines.
-
FacetFence Product Filters
(0 total ratings)Protect WooCommerce filtered URLs from crawl floods with noindex/canonical controls, signed cookies, rate limits, logs, and rollback.
-
LLMAffiliate AI Traffic Monetizer
(0 total ratings)Detect LLM user agents, enforce Google parity, and serve enhanced content through a configurable content service.
-
Softrecs AI Crawler Checker
(0 total ratings)Can GPTBot, ClaudeBot, PerplexityBot and Googlebot reach your site? robots.txt per bot, a live test, a bot visit log and a weekly email alert.
-
Valvai – AI Traffic Control Center
(0 total ratings)Block, log and monetise AI crawlers directly from your WordPress dashboard.
-
Limpark Bot Monitor
(0 total ratings)Monitor search engine bots visiting your WordPress website in real time.
-
AI Kansoku Lab Tracker
(0 total ratings)Track AI crawler visits such as GPTBot, ClaudeBot, and PerplexityBot server-side and visualize them in WordPress.
-
Msite AI Crawler Monitor
(0 total ratings)See which AI crawlers visit your site and check that your site is technically ready for AI engines. Hebrew and RTL friendly.
-
AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control
(0 total ratings)Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.
-
AI Bot Monitor
(0 total ratings)Tracks and logs AI, Search and Social bots including ChatGPT, Perplexity, Googlebot, Bing and Meta crawlers.
-
Spuncin
(0 total ratings)Blocks AI crawlers that collect your content to train models. Search engines and link previews are never touched.
-
NMOS Crawl Tracking
(0 total ratings)Install NMOS.NET meta tag, tracking.js, and optional no-JS beacon on your WordPress site.
-
ADG Markdown for AI Crawlers
(0 total ratings)Serve AI crawlers clean Markdown of your content on the same URL, and auto-generate llms.txt / llms-full.txt (with an on-disk fallback).
-
Zicy AI Access Monitor
(0 total ratings)Monitor known AI crawlers and AI assistant fetches, with daily rollups, CSV exports, weekly summaries, and page briefs.
-
Okibako AI
(0 total ratings)Records which AI crawlers actually fetch your pages, checks what they can read, and serves llms.txt — no database tables, no IPs stored.
-
AI Crawler Guard
(0 total ratings)Detect and control AI crawler access with local logging and history.
-
BotObservatory – Live Bot Tracker & Anti-Scraper
(1 total ratings)Observe human and machine traffic, identify suspicious automation, and optionally quarantine aggressive scrapers.
-
Virtual LLMS.TXT Generator
(0 total ratings)Publish a safe, configurable llms.txt map from public WordPress content, with an opt-in bounded full-text export.
-
SeoNova Bot Radar
(0 total ratings)Bot traffic radar: who visits your site, what they are after, and what they cost you in money.