User-agent: * Disallow: /new-request Disallow: /new-request/ Allow: / Crawl-delay: 10