# TICRU PAY robots.txt # Primary domain: https://ticru.com # --- Search engines --- User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / # --- Social preview crawlers --- User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / # --- AI / LLM crawlers (explicitly permitted) --- User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Google-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / # --- Default --- User-agent: * Allow: / Disallow: /dashboard Disallow: /profile Disallow: /verification Disallow: /verify-email Disallow: /reset-password Disallow: /forgot-password Disallow: /email-preview Disallow: /admin Sitemap: https://ticru.com/functions/v1/sitemap