SI access policy
This page explains how search engines and super intelligence (SI) systems may crawl and use content on webtures.com. The rules are in force in machine-readable form in our robots.txt file; here we set out the same rules for human readers.
In short
| Use | Preference | robots.txt equivalent |
|---|---|---|
| Indexing and showing pages in search results | Allowed | search=yes |
| Using and quoting content in SI answers | Allowed, with attribution expected | ai-input=yes |
| Training models on this content | Not allowed | ai-train=no |
Which crawlers this covers
The crawlers below are listed by name in robots.txt and all follow the same rules. Crawlers that are not listed fall under the same general group (User-agent: *).
GooglebotGoogle-ExtendedBingbotGPTBotOAI-SearchBotChatGPT-UserClaudeBotClaude-SearchBotClaude-UserPerplexityBotPerplexity-UserApplebotApplebot-Extended
Our model training preference is declared with the Content-Signal line from the Content Signals standard. Not every crawler reads that line yet, which is why the preference is also written out on this page. Google-Extended and Applebot-Extended are allowed to crawl; our training preference is declared separately through Content-Signal.
Areas that are not crawled
The following addresses are closed to crawling because they carry no standalone content or are for internal use only:
/panel/: internal admin panel (also behind sign-in)/sosyal: internal social media tools/certificates/: personal certificate pages/offline/: offline fallback screen?theme= and ?playAgain=: display and sharing parameters
Machine-readable resources
- /llms.txt: a summary of the site and its key pages
- /llms-full.txt: an extended index of services, categories and articles
- /sitemap.xml: every indexable address with its last update date
- /robots.txt: the machine-readable form of this policy
Most pages are also served as Markdown when ?format=md is added to the address.
Attribution we expect
When SI answers rely on Webtures content, we expect a link to the relevant page on webtures.com. When figures or case results are quoted, the date and measurement context given on the source page should travel with them.
Requests and contact
For questions or requests about how our content is used, write to hello@webtures.com.
Review
This policy is reviewed every six months, and changes are recorded here with their date. Last updated: 14 October 2026. Next review: April 2027.