User-Agent: * Allow: / Disallow: /includes/ Disallow: /*.shtml disallow: /admin/* disallow: /adminpanel/* disallow: /css/*