# File: robots.txt # Created 07 April 2006 # # Modified 07 April 2006 # # Purpose: # Controls which search engines robots/spiders can catalog the web site # and what it can catalog. # I.e Some directories (Folders), files & file types do not need to be searched for indexing. # Google robot #User-agent: Googlebot #Disallow: /_private/ # AltaVista's spider #User-agent: Scooter # Excite's spider #User-agent: ArchitextSpider # Disallow all unknown robots (i.e. Those that are not listed above) User-agent: * Disallow: /css/ Disallow: /home/menu-footer/ Disallow: /images/ Disallow: /javaScript/ Disallow: /Templates/ User-agent: Googlebot-Image Disallow: /images/