#************************************************************* # ROBOTS.TXT File (www.cramerscrossing.org) # # Search engines will look in the root domain for a special # file named "robots.txt" (http://www.mydomain.com/robots.txt). # The file tells the robot (spider) which files it may spider # (download). This system is called, The Robots Exclusion # Standard. # # File Convention: # # Each record consists of two fields : a User-agent line and # one or more Disallow: lines. The format is: # ":" # # Examples: # # User-agent: googlebot # User-agent: * # Disallow: email.htm # Disallow: /cgi-bin/ # # User-agent: googlebot # Disallow: cheese.htm # If you leave the Disallow line blank, it indicates that ALL # files may be retrieved. At least one disallow line must be # present for each User-agent directive to be correct. # A completely empty Robots.txt file is the same as if it # were not present. # #************************************************************* User-agent: * Disallow: /_private/ Disallow: /App_Data/ Disallow: /cgi-bin/ Disallow: /documents/ Disallow: /images/ Disallow: about.html Disallow: archive.html Disallow: board.html Disallow: committees.html Disallow: contacts.html Disallow: documents.html Disallow: events.html Disalow: eventsignup.html Disallow: eventsignupvalidate.html Disallow: fact.html Disallow: feedback.html Disallow: forms.html Disallow: gallery.html Disallow: index2.html Disallow: links.html Disallow: phone.html Disallow: traffic.html Disallow:whyisit.html Disallow: cchoa_template1.dwt Disallow: cchoa_template2.dwt Disallow: cchoa_template3.dwt