# This is for every spider! User-Agent: * # stay away from this Disallow: /usage/ #and everything in it Disallow: /buttons/ #and everything in it Disallow: /cgi-bin/ #and everything in it Disallow: /documentation/ #and everything in it Disallow: /forms/ #and everything in it Disallow: /Library/ #and everything in it Disallow: /maps/ #and everything in it Disallow: /nf_docs/ #and everything in it Disallow: /cgi-bin/ Disallow: /x_media/ Disallow: /analogue/ Disallow: /xsummary/ Disallow: # a little nothing Disallow: #This could be habit forming! # Don't comments make code much more readable!!!