# robots.txt # To disallow search engines indexing defined parts of Townsend Chem site. User-agent: * # Directed to ALL spiders Disallow: /ssl Disallow: /media Disallow: /images Disallow: /ftp Disallow: /errormsg Disallow: /css Disallow: /aspnet_client