# Search indexing: allow User-agent: Googlebot Allow: / Disallow: /app/ Disallow: /zh/app/ User-agent: Bingbot Allow: / Disallow: /app/ Disallow: /zh/app/ User-agent: Applebot Allow: / Disallow: /app/ Disallow: /zh/app/ # AI search & retrieval: allow User-agent: OAI-SearchBot Allow: / Disallow: /app/ Disallow: /zh/app/ User-agent: Claude-SearchBot Allow: / Disallow: /app/ Disallow: /zh/app/ User-agent: PerplexityBot Allow: / Disallow: /app/ Disallow: /zh/app/ # User-triggered assistants: allow User-agent: ChatGPT-User Allow: / Disallow: /app/ Disallow: /zh/app/ User-agent: Claude-User Allow: / Disallow: /app/ Disallow: /zh/app/ # Training crawlers: block User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / # Publisher opt-out User-agent: Google-Extended Disallow: / # Explicitly blocked crawlers User-agent: Bytespider Disallow: / # Default: block any undeclared crawler User-agent: * Disallow: / Sitemap: https://app.profilemesh.com/sitemap.xml