Telling Google, What not to index - Googlebot Rocks!

We realize that you may have some pages that you don't want Google to access.  For instance, you may not want Googlebot, our automated page fetching robot, accessing documents with private information or pages you're simply not ready to show the world.   In cases like this, you'll want to use one of two reliable methods for blocking us from this content:  a "Disallow" line in your robots.txt file or a noindex meta tag on each you don't want indexed.

0 comments: