User-agent: * # Search Disallow: /search/ # Prevent crawling DFP tags Disallow: /359/ #Prevent crawling content with default url aliases Disallow: /content/ #Prevent crawling blaize datalayer Disallow: /blaize/datalayer Sitemap: https://theweek.com/sitemap.xml