# 2004/11/19 Sylvain Robitaille: Robots Exclusion file for NewClyde. # ---------- # # Some web search engines are indexing web pages that shouldn't be # indexed. We can have them exclude certain portions of our server. # # Note that this file contains one line for each part of the web server # that is to be excluded from web indexes. Regular expressions are not # recorgnized. Blank lines within a record are not permitted, as these # are used to delimit multiple records. # # See http://info.webcrawler.com/mak/projects/robots/exclusion.html # for a complete description of this file. # All search engines: User-agent: * # # Support files: Disallow: /indices/ Disallow: /style/ Disallow: /cgi-bin/ Disallow: /icons/