# InvestBuddy.ai Robots.txt # PUBLIC BETA: Search engines can now index the site User-agent: * Allow: / # Disallow private/sensitive areas Disallow: /api/* Disallow: /admin/* Disallow: /settings Disallow: /dashboard Disallow: /portfolio Disallow: /recommendations Disallow: /subscription/success Disallow: /subscription/cancelled # Sitemap location Sitemap: https://www.investbuddy.ai/sitemap.xml # Crawl-delay for polite crawling (Bing/Yandex only) Crawl-delay: 1