jeremy-h of Web Development
11/3/2017 - 5:38 PM

Robots.txt

Basic robots file

Robots.txt
content_copyfile_download
User-agent: *
Sitemap: Full URL of website’s homepage
Disallow: /test/