# /robots.txt file # mail webmaster@webcrawler.com for constructive criticism User-agent: *