# # This file is used to allow crawlers to index our site. # # Details about Googlebot available at: http://www.google.com/bot.html # The Google search engine can see everything User-agent: Googlebot Disallow: /administer/ Disallow: /aspnet_client/ Disallow: /old-site/ Disallow: /siteobjects/ Disallow: /user_area/ Disallow: /assets/ # All other robots will be restricted from accessing the Google-specific index pages User-agent: * Disallow: /administer/ Disallow: /aspnet_client/ Disallow: /old-site/ Disallow: /siteobjects/ Disallow: /user_area/ Disallow: /assets/