# www.robotstxt.org/ # http://code.google.com/web/controlcrawlindex/ User-agent: * Disallow: Sitemap: http://www.websilk.com.au/sitemap.xml User-agent: AhrefsBot Disallow: /