Results 1 to 2 of 2
October 18th, 2006, 06:40 AM #1
Indexing a forum in search engines...
- Join Date
- October 18th, 2006
Ok so we want GOOGLE to index the forum but its a paid forum so we want a message to popup when they try and access from google saying that this is the case...
October 18th, 2006, 07:07 AM #2
I imagine you'd have to have each page check the the "user agent", if it's googlebot etc crawling, let it have member level access and crawl the site. If it's "ie" or any browser make them log in.
Remember google doesn't like session ids or session cookies so you'd have to perform the user agent check for every single page using this method.
You could also use googlebots IP range to identify it. This would be more secure in that it would prevent people faking googlebots user agent name to gain access to your forums.
There are probably other methods using .htaccess but I'm not too clear on how this would be done.
Also as an addditional check, you could make each page check the refering pages domain and have a special message for vistors coming from search engines.
By John Powell in forum Search Engine OptimizationReplies: 12Last Post: November 6th, 2009, 08:53 PM
By jc101 in forum Search Engine OptimizationReplies: 3Last Post: January 28th, 2007, 09:19 AM
By c4 in forum Search Engine OptimizationReplies: 3Last Post: June 12th, 2003, 06:44 PM
By c4 in forum Search Engine OptimizationReplies: 4Last Post: February 28th, 2002, 08:09 AM