# --------------------------- # Standard Robots.txt Template # Works for: SaaS, Agencies, Webflow, Marketing Sites, Blogs # --------------------------- User-agent: * # Allow search engines to crawl all essential pages Allow: / # Block non-essential or system pages Disallow: /404/ Sitemap: https://www.decisionx.ai/sitemap.xml