# Crawloria

> Free AI Agent Optimization (AAO) audit tool. Paste any URL, get a 0-100 score with a sample agent-resolution render and prioritized fixes for ChatGPT, Claude, Perplexity, and other AI agents that browse the web on behalf of users. No signup, no email gate.

Crawloria measures how well a site works for vision-based and crawler-based AI agents. The scoring engine probes seven AI crawler User-Agents (GPTBot, ClaudeBot, OAI-SearchBot, PerplexityBot, CCBot, anthropic-ai, Google-Extended), inspects rendered DOM at the documented Anthropic Computer Use viewport, validates Schema.org and Open Graph metadata, checks for cookie/sign-up modal blockers, and surfaces real-time search visibility for the brand's category.

## Documentation

- [Methodology](https://www.crawloria.com/methodology): How Crawloria calculates the AI Agent Readiness score across six weighted categories. Bot Access (25%), Content Accessibility (20%), Structured Data (15%), Navigation Friction (15%), Agent Signals (15%), Semantic Markup (10%). Includes letter-grade bands and category-by-category check definitions.
- [Claim or remove an audit](https://www.crawloria.com/claim): How site owners can take ownership of, edit, or remove a public audit page. Audit pages are noindex by default, but they remain shareable public URLs.

## Blog

- [Perplexity Brand Monitoring: Tools & Workflow](https://www.crawloria.com/blog/perplexity-brand-mention-monitoring): Perplexity AI brand mention monitoring: how the sources panel forms, five tools with verified pricing, and a DIY workflow you can run this week.
- [PerplexityBot: How Perplexity Crawls Your Site](https://www.crawloria.com/blog/perplexitybot): PerplexityBot vs Perplexity-User: user agents, IP ranges, robots.txt behavior, the Cloudflare dispute, and whether merchants should block or allow.
- [AI Search Content Checklist: 12 Pre-Publish Checks](https://www.crawloria.com/blog/ai-search-content-optimization-checklist): A 12-point AI search content optimization checklist for content teams: what to verify before publish, how to check it, and the done criterion for each.
- [Shopify Agentic Commerce: 2026 Merchant Map](https://www.crawloria.com/blog/shopify-agentic-commerce): Shopify agentic commerce mapped for merchants: Catalog, Agentic Storefronts, UCP, agentic checkout. What to enable, what to verify, what to watch.
- [Gemini Visibility Tracker: Tools & DIY Setup](https://www.crawloria.com/blog/gemini-visibility-tracker): Gemini visibility tracker shortlist with verified June 2026 pricing, plus a DIY workflow to track your brand in Google Gemini without buying a tool.
- [OAI-SearchBot: The Crawler Behind ChatGPT Search](https://www.crawloria.com/blog/oai-searchbot): OAI-SearchBot indexes your site for ChatGPT Search. The verified user agent string, IP verification, log checks, and whether you should block it.
- [llms.txt Examples: 6 Real Files, Annotated](https://www.crawloria.com/blog/llms-txt-examples): Six real llms.txt examples from Anthropic, Cloudflare, Vercel, Stripe, Cal.com, and Supabase, annotated. Plus the format spec and a starter template.
- [Shopify ChatGPT Integration: Merchant Guide](https://www.crawloria.com/blog/shopify-chatgpt-integration): Shopify's ChatGPT integration is on by default, but visibility isn't. Eligibility checklist, product data fixes, and how to verify you show up.
- [10 Best LLM Rank Trackers (2026)](https://www.crawloria.com/blog/best-llm-rank-trackers-2026): Vendor-neutral list of 10 LLM rank trackers with prices checked June 2026. Coverage, refresh cadence, and which vendors hide pricing.
- [GPTBot: What It Is and How to Control It](https://www.crawloria.com/blog/gptbot): GPTBot is OpenAI's training crawler. Get the user-agent string, robots.txt syntax, log checks, and a 2026 framework for deciding whether to block it.
- [Ecommerce GEO: A Working Playbook for 2026](https://www.crawloria.com/blog/ecommerce-geo): Ecommerce GEO playbook for DTC. Signals that move citation share, how to measure inclusion without a vendor tool, agent-as-buyer angle.
- [AI Agents for E-Commerce: A Buyer's Map](https://www.crawloria.com/blog/ai-agents-for-ecommerce): AI agents for e-commerce in five categories — support, sales, ops, discovery, plus the agents arriving as buyers nobody else covers.
- [llms.txt Best Practices: 2026 Practical Guide](https://www.crawloria.com/blog/llms-txt-best-practices): Best practices for writing an llms.txt file in 2026: what to include, what to skip, and verified real-world adopter patterns from Anthropic to Stripe.
- [How Generative AI Is Changing Brand Visibility](https://www.crawloria.com/blog/generative-ai-impact-brand-visibility): Three measurable shifts generative AI creates in brand visibility, what they break in classical measurement, and what execs should change this quarter.
- [Agentic SEO in 2026: Two Definitions, One Pick](https://www.crawloria.com/blog/agentic-seo): Agentic SEO means two things: AI agents doing SEO work, or SEO optimizing for AI agents. Definitions, contrast, and which to focus on.
- [AI Citations vs Google Rankings in 2026](https://www.crawloria.com/blog/ai-citations-impact-on-google-seo-rankings): Only 38% of AI Overview cited pages also rank in the top 10 (Ahrefs). What that breaks for traditional SEO, why it broke, and five fixes that work today.
- [Why Monitor Brand Mentions in AI Search](https://www.crawloria.com/blog/why-monitor-brand-mentions-in-ai-search): Five concrete business consequences of leaving AI brand mentions unmonitored, plus a decision framework for whether your business needs to.
- [AI Brand Tracking: A 2026 Operator Guide](https://www.crawloria.com/blog/ai-brand-tracking): AI brand tracking now means watching how ChatGPT, Perplexity, and AI Overviews describe your brand. Concept, four surfaces, three metrics, starter plan.
- [How to Monitor Brand Mentions in AI Search](https://www.crawloria.com/blog/monitor-brand-mentions-in-ai-search): Best ways to monitor brand mentions in AI search — a weekly 30-minute workflow with 12 prompts, Google Sheet template, and alert thresholds.
- [How to Rank in ChatGPT Search (2026 Guide)](https://www.crawloria.com/blog/how-to-rank-in-chatgpt-search): How to rank in ChatGPT Search: a step-by-step guide. ChatGPT doesn't rank pages — it cites them. Here's how citations work and how to become one.
- [10 Best ChatGPT SEO Tracking Tools 2026](https://www.crawloria.com/blog/best-chatgpt-seo-tools-2026): Best ChatGPT SEO tracking tools evaluated across the same prompt set — neutral matrix of 10 platforms, citation behavior and where each falls short.
- [10 Best Google AI Mode Tracking Tools 2026](https://www.crawloria.com/blog/best-ai-mode-tracking-tools-2026): Best AI Mode tracking tools for Google's new generative search surface — neutral matrix of 10 platforms, citation coverage and what each does best.
- [LLMO Explained: A 2026 Practical Guide](https://www.crawloria.com/blog/llmo-large-language-model-optimization-explained): What LLMO actually means in 2026, how it differs from SEO/GEO/AEO, and a 3-pillar framework (Index, Cite, Convert) for content teams.
- [10 Techniques to Boost AI Search Visibility](https://www.crawloria.com/blog/techniques-for-boosting-visibility-in-ai-search): Ten implementation-level techniques for boosting visibility in AI search algorithms. Each maps to a specific fix, time budget, and expected lift.
- [How to Optimize for AI Overviews: Playbook](https://www.crawloria.com/blog/how-to-optimize-for-ai-overviews): An iterative optimize-measure-iterate playbook for Google AI Overviews. Each tactic mapped to citation-rate impact. Free measurement template included.
- [Brand Visibility in AI Search: 12-Week Plan](https://www.crawloria.com/blog/improve-brand-visibility-in-ai-search-engines): 12-week DTC playbook to improve brand visibility in AI search engines. Schema, prompts, content rhythm, monitoring. Built for under $50M revenue brands.
- [What Triggers an AI Overview: E-Commerce Cut](https://www.crawloria.com/blog/what-triggers-an-ai-overview-ecommerce): Which e-commerce queries trigger Google's AI Overviews and which don't. Product, category, and comparison patterns with verified SE Ranking data.
- [How to Structure Content for Google AI Overviews](https://www.crawloria.com/blog/how-to-structure-content-for-google-ai-overviews): Structural patterns Google's AI Overviews cite: heading layout, paragraph length, schema, list rules. Copy-paste templates for DTC and SaaS pages.
- [Optimize Website for ChatGPT: 8 DTC Checks](https://www.crawloria.com/blog/optimize-website-for-chatgpt): Eight checks every DTC merchant should run to get cited by ChatGPT: crawler access, schema, reviews, structure. Plus what doesn't move the needle.
- [Top AI SEO Agencies 2026: Honest Comparison](https://www.crawloria.com/blog/top-ai-seo-agencies-2026): 9 AI SEO agencies compared on what they deliver for DTC and SaaS. Methodology, pricing, weak spots — plus Crawloria's own honest listing.
- [AI Commerce May 2026: UCP, OpenAI, Mastercard](https://www.crawloria.com/blog/ai-commerce-recap-may-2026): Agentic commerce May 2026: UCP Council expansion, ChatGPT retailer-app pivot, Mastercard Agent Pay on Copilot, Visa Trusted Agent Protocol.
- [AI SEO vs Traditional SEO: What Changed in 2026](https://www.crawloria.com/blog/ai-seo-vs-traditional-seo): AI SEO vs traditional SEO compared across 6 dimensions: ranking signals, content, measurement, ROI, tooling. What's genuinely new vs rebrand.
- [11 Best LLM SEO Tools for 2026: Honest Comparison](https://www.crawloria.com/blog/best-llm-seo-tools-2026): 11 LLM SEO tools tested across ChatGPT, Claude, Perplexity, Google AI Mode. Pricing, what each does best, where each falls short. Vendor-neutral.
- [AI Shopping Monitoring for Shopify: 2026 Guide](https://www.crawloria.com/blog/shopping-engine-search-monitoring-shopify): How DTC Shopify merchants can monitor ChatGPT, Perplexity, AI Overviews, Gemini visibility. Checks, tools, the 4 blockers we keep finding.
- [AEO vs SEO: 5 Fundamentals That Still Work in 2026](https://www.crawloria.com/blog/aeo-vs-seo-fundamentals): AEO didn't replace SEO. 5 fundamentals — sitemap, canonical, OG, internal links, title/meta — still feed ChatGPT, Claude, Perplexity, AI Mode.
- [How to Show Up in AI Overviews: 2026 Playbook](https://www.crawloria.com/blog/how-to-show-up-in-ai-overviews-seo): How to rank in Google's AI Overviews: the eligibility floor, four signals that move the needle, and the failure modes we keep finding in audits.
- [GPTBot, ChatGPT-User, OAI-SearchBot: 4 Classes](https://www.crawloria.com/blog/four-classes-of-ai-bots): 4 classes of AI bots crawl your site: training, indexing, real-time fetchers, and autonomous agents. How to configure robots.txt + WAF for each.
- [llms.txt Explained: Who Uses It and Why](https://www.crawloria.com/blog/llms-txt-explainer): What llms.txt is, who reads it (Anthropic, Cloudflare AutoRAG, Mintlify), and a decision tree for whether your site needs one.
- [Cloudflare Bot Fight Mode Blocks AI on Shopify](https://www.crawloria.com/blog/cloudflare-bot-fight-mode-ai-agents-shopify): Cloudflare Bot Fight Mode 403s GPTBot and PerplexityBot on Shopify by default. Find and fix the 5 WAF settings behind it.
- [7 Strategies for Brand Visibility in AI Search](https://www.crawloria.com/blog/what-strategies-improve-brand-visibility-in-ai-search-engines): The most effective strategies for AI visibility in ChatGPT, Perplexity, and Google AI Overviews — plus the mistakes that don't move the needle.
- [Shopify ChatGPT Checkout: 5 Walls Blocking AI Agents](https://www.crawloria.com/blog/shopify-chatgpt-checkout-walls): ChatGPT Operator, Claude for Chrome, Perplexity Comet abandon Shopify checkouts before payment. 5 settings cause it. 4 are config you can change today.
- [ChatGPT Not Showing Your Site? 9 Causes & Fixes](https://www.crawloria.com/blog/chatgpt-not-showing-your-website): If your site doesn't appear in ChatGPT search or get recommended by Operator, the cause is almost always one of these 9 fixable issues.
- [How AI Agents See Your Site: 1568-Pixel Rule](https://www.crawloria.com/blog/ai-agent-screen-resolution): AI agents like Claude Computer Use see your site at 1568px max - half the resolution you designed for. 7 elements disappear. Here's how to fix it.

## Try it

- [Run a free audit](https://www.crawloria.com): Paste any URL to scan. About 20 seconds. Returns a public audit page with score, sample render, and a prioritized issue list.