I have my site set so that only registered users can see the content. Is there a way to let Google see my pages, so it knows what content I have other than my front page? Or is the only way to let Google know what the content is through meta tags? (On a side note, where do you set meta tags in Druapl at?)

Comments

styro’s picture

Google is an anonymous user so Google sees what an anonymous user sees. And if somehow just Google could get in (by some sort of IP restriction etc), then you've just allowed anonymous users to see your content through the Google cache anyway.

Your content is either private or not. If Google can see it, it is no longer private.

You could try something like the premium module (I haven't used it myself, so I'm not sure if it actually does that) where teasers are public, but only registered users get to see the full content. And using the excerpt module lets you create a separate custom teaser for each node.

--
Anton
New to Drupal? | Forum posting tips | Troubleshooting FAQ
Example Knowledge Base built using Drupal

freehunter’s picture

Well, I know Google uses a different browser than normal users, and they follow the guidelines of robots.txt and whatnot, I was wondering if the site would let search crawlers in but not normal users. There has got to be a way, right? Search crawlers identify themselves as Googlebot version whatever, Yahoobot, etc, and use text only browsers. If someone is willing to use a Googlebot and view my site in text only, really they should be allowed access anyway, if they want it that bad :p

pobster’s picture

If you're not 'all that concerned' about people being able to browse your site then why have it private anyway? Why not just make it public and be done with it?

Pobster

freehunter’s picture

I don't want to make it public because my web host can only handle a very limited amount of users. By keeping it private, I can control how many people can access the site.

michelle’s picture

Then you don't want Google spidering it... Google and other bots can hit a site pretty hard.

Michelle

jacauc’s picture

maybe you should consider another hosting company then...
Try bluehost. I'm with them, and I love it.
http://www.dieinter.net/bluehost_is_great

cheers