User-Agent: * Allow: / Allow: /index.php Allow: /robots.txt Allow: /sitemap.xml Allow: /view Disallow: /model Disallow: /js Disallow: /img Disallow: /func Disallow: /css Disallow: /control Disallow: /*.asp$