# Don't allow web crawlers to index Craft CMS User-agent: * Disallow: /craft/ Disallow: /demo Disallow: /devnotes Disallow: /docs Disallow: /docs/ Disallow: /section-demo Disallow: /mimic Disallow: /mimic/