# robots.txt - restricts access to compliant web crawlers User-agent: * Disallow: /test/