AI Bot Accessibility
robots.txt, GPTBot/ClaudeBot/PerplexityBot permissions, firewall restrictions and dynamic content access.
Çıktı · Access MapGPT, Claude, Perplexity and Gemini turned search into answer generation. We scan your site across 50+ criteria, prioritise the risks and hand you a 14-day action plan.
Models compare and recommend on the user's behalf. The numbers show the structural shift between 2025 and 2026.
More than half of Google searches now end with zero clicks.
SparkToro 2024Weekly active ChatGPT users; search became an answer-generation surface.
OpenAIGrowth in referral traffic shifting from traditional SERPs to LLM surfaces.
SimilarWeb 2025Share of B2B buyers researching purchases through ChatGPT or Perplexity.
Gartner 2025Brands budgeting AI Search Optimization as a separate line in 2026.
Forrester 2025How much more often sites optimised with llms.txt and structured data get cited by LLMs.
Webtures LabSix outcomes that start where traditional SEO ends — each one measurable.
Your brand is cited as a source in ChatGPT, Perplexity, Gemini and Copilot answers; customers discover you, not your competitor.
Beyond keywords: we analyse how AI agents perceive your content and surface intent, trends and opportunities.
From schema markup to contextual optimisation; we structure your content so models recognise and cite it.
Against declining organic traffic we build durable visibility with GEO and LLMO — a strategy that still holds tomorrow.
We track how often you appear in AI answers, which pages get cited and what converts; prompts and citations become clear KPIs.
The AI search ecosystem changes weekly. We iterate content, schema and entity signals quickly and test across models.
We analyse the site across 50+ criteria from the AI's read–evaluate–pick-a-source perspective, not the SEO one.
robots.txt, GPTBot/ClaudeBot/PerplexityBot permissions, firewall restrictions and dynamic content access.
Çıktı · Access MapHeading hierarchy, semantic HTML, structured data, entity clarity and citability.
Çıktı · Schema + Entity ScoreServer-side rendering, API access, form & checkout automation, machine readability of the data layer.
Çıktı · API + SSR ReportSource-selection potential, per-model visibility, reference frequency and brand mention density.
Çıktı · Citation IndexSchema.org coverage, JSON-LD, Org/Product/FAQ/Review, rich properties.
llms.txt, AGENTS.md, sitemap, robots, canonical, OG, meta description.
Heading hierarchy, semantic HTML, alt text discipline, block structure.
HTTPS, mobile viewport, Core Web Vitals, low error rate.
Public API endpoint, OpenAPI documentation, CORS configuration.
MCP manifest, function calling readiness, Plugin/Actions structure.
How often GPT, Claude, Perplexity and Gemini source you in answers.
Knowledge graph clarity, external reference consistency, entity links.
Access, schema, product feed, freshness, visibility and measurement are scored as one chain: a site with a flawless feed that blocks crawlers cannot score well. As the scan finishes, the verifiable items in the 186-item checklist below are ticked automatically.
OAI-SearchBot and Google-Extended in robots.txt, HTTP status for agent user-agents, JS-free visibility, sitemap.
Organization, Product and Offer schema, ISO 4217, availability enum, GTIN/MPN coverage, variant model.
Required fields, id uniqueness, GTIN ratio, price format, product link status codes.
Sampled comparison of feed vs on-site price, feed reachability.
llms.txt, target-market language and hreflang, fact density, FAQ and comparison signals.
GA4 and GTM detection, pixel and conversion measurement signals.
| Score | Tier | Meaning |
|---|---|---|
| 0–25 | Invisible | Agents cannot read the site or understand the product. |
| 26–50 | Accessible | Agents can read it, but the data is not trustworthy. |
| 51–75 | Feed-Ready | Data is reliable, but visibility and measurement are missing. |
| 76–90 | Agent-Native | The channel is live and measured. |
| 91+ | Reference | Mature, including governance and trust layers. |
The technical answer to "I sell to the US — why don't I show up in ChatGPT?"
A fast, evidence-grade starting point for client audits and proposals.
A tier assignment and a prioritised first 90 days.
Agents read data, not design. Every item states what should be true, its proof and its weight. Your progress is stored in your browser; the scan auto-ticks the 47 items tagged auto — the remaining 139 can only be verified from inside the company.
Chain rule: Investment that skips this order is wasted — a site with a perfect feed but blocked bots is never found. Critical items are worth 3 points, important 2, maturing 1; 431 in total. Drop inapplicable sections from the denominator and evaluate by percentage. A B2B firm without a product feed can skip Parts 3 and 5; Parts 1, 2, 7, 8 and 9 apply to everyone.
| Percent | Tier | Meaning | Next move |
|---|---|---|---|
| 0–25% | 0 · Invisible | Agents cannot read the site | Parts 1 and 2 |
| 26–50% | 1 · Accessible | Readable, data untrustworthy | Parts 3 and 6 |
| 51–75% | 2 · Feed-Ready | Data good, no visibility or measurement | Parts 8 and 9 |
| 76–90% | 3 · Agent-Native | Channel live and measured | Parts 4 and 10 |
| 91%+ | 3+ · Reference | Mature incl. governance | Pilot leadership |
Critical rule: A tier is not earned until a part's critical items are complete — with OAI-SearchBot blocked in robots.txt, the effective tier is 0 even at 80%.
All of Part 1; 2.1–2.12; 9.1–9.3 and 9.9 (baseline); 8.1–8.2 (prompt set and first measurement).
All of Part 3; 6.1–6.4 and 6.7; 5.1–5.3 (unit economics); 12.1–12.2.
4.1, 4.4, 4.5, 4.9; the rest of Part 8; 7.3, 7.5, 7.6, 7.9; Part 10 if exporting; Part 11 review.
If any of these is true, stop everything else:
The site is reviewed across 50+ criteria: AI bot access, content architecture, structured data and technical infrastructure one by one.
Gaps are classified by impact; the areas directly affecting AI visibility are clarified and action priority is set.
Concrete recommendations for each risk: technical work, content and strategic structuring delivered as a 14-day roadmap.
Background reading for the checklist items on this page.
We scan 50+ criteria, measure your GPT/Claude/Perplexity/Gemini visibility and prepare your prioritised 14-day action plan.
We send a real request as each AI crawler, using its own user agent. Even when robots.txt allows a bot, the server or firewall can still turn it away; this table separates the two.
A fix prompt is ready for every finding in this report. If you like, a Webtures expert reads the report with you in a free 30-minute call and prioritises the 14-day plan.
We run audit workshops for items verified internally, such as stock accuracy, margins and authority thresholds.
0 missing items, ordered by their impact on the score. Completing the first 5 would take your score to roughly .
Hand it to your technical team, or let Webtures run it under an outcome-based contract — with milestones like "feed validated".