#To shut down site completely from bots use
 Disallow: /