user-agent: anthropic-aiBytespider Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Claude-Web Disallow: / User-agent: magpie-crawler Disallow: / User-agent: news-please Disallow: / User-agent: FacebookBot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Applebot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: Buck Disallow: / # START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://uat-the-tls.co.uk/sitemap_index.xml # --------------------------- # END YOAST BLOCK