User-agent: * # Block backend admin areas Disallow: /admin/ Disallow: /sidekiq/ # Block member and advertiser areas Disallow: /members/ Disallow: /advertisers/ # Keep noindex tracking redirects crawlable so bots can read X-Robots-Tag. # Other redirect routes remain blocked. Disallow: /refers/ # Block editor assets and uploads backend Disallow: /ckeditor/ # Allow crawling of everything else (including listing pages, pagination, etc.) Allow: / Sitemap: https://londonescortguide.com/sitemaps/sitemap.xml