Private Pages…

[Tall Midget]

Is there a way to keep pages from being picked up by the spiders?

I am attempting to keep all eyes off of a page

that is intended for a special group only!

All suggestions will be appreciated…

Bob Newton

[amin007]

You can specify in your robots.txt file that you don’t want the Serach engine spiders to crawl this page. This post explains the theory:

http://www.tipsandtricks-hq.com/how-to-control-access-of-the-web-crawlers-or-web-robots-to-your-site-166

Alternatively you can place the following meta tag in the page that you don’t want search engines to pick up:

<meta name="robots" content="noindex,nofollow">

If you want to keep the content of that page private you should consider using a membership plugin. For example, when you protect a page using eMember the protected content cannot be accessed by the spiders.

[Author]

Posts