Results 1 to 9 of 9
August 4th, 2005, 01:13 PM #1Can anybody help me with this please?
I want to remove some URL's from Google's index as I have changed the sites navigation methods. They are still listing URL's like mysite.com/?b= and mysite.com/?a= and mysite.com/?ip=
I am wondering is there anything I can put in either the .htaccess or the robots.txt file that will prevent them listing/cause them to remove as dead links all files that start with mysite.com/?b= and mysite.com/?a= and mysite.com/?ip=
Thanks in advance for any help.
[edited to add] Am I correct in thinking these in my robots.txt file would do what I am asking above?
or maybe like this
Last edited by Gordon; August 4th, 2005 at 01:24 PM.
August 4th, 2005, 01:24 PM #2
how about the new google site map deal where you tell them what the pages of your site are - I would guess that would remove the ones you don't tell them exist...
August 4th, 2005, 01:26 PM #3
Thanks donuts. I've not managed to get the sitemap program working yet, my server does not allow me to run a script on it. I am with httpme.com
August 4th, 2005, 02:10 PM #4
I believe htaccess would be the route to go.
I'm fairly new to writing rewrite rules but I think I've read somewhere you can write a rule to forward all those type of urls to a 404 page or do a moved permanently 301 or 302 redirect (I forget which one is which) and redirict to the appropriate page. You would have to get up to speed with regular expressions.
The robots.txt file basically tells the bots what directories they are allowed to access. It doesn't tell them that a page has moved or is no longer available (I think).
Do a search for mod-rewrite htaccess. There's a good forum on it out there. I had some good tutorials bookmarked but have switched computers and left those bookmarks behind.
August 4th, 2005, 02:24 PM #5Originally Posted by Gordon
Look for "Text file" at top of page and last section on bottom of page.
August 4th, 2005, 03:07 PM #6
Originally Posted by suzigeek
- Join Date
- January 17th, 2005
- Choctaw, Oklahoma
here's what you put in your htaccess file:
redirect 301 /thisisoldfile.html http://www.thisisnewfile.com/newfile.html
Use 301 since it is a permanent change (and I read somewhere google does not like 302's anyway)
Peace & Blessings,
White WolfBlessed Be,
August 4th, 2005, 04:46 PM #7
August 4th, 2005, 10:20 PM #8whoa, folks!
the last time I went to google.com/addurl I saw a box where you could report a dead url.
August 4th, 2005, 10:42 PM #9
- Join Date
- January 18th, 2005
- Los Angeles
No problem with 301 redirects for absent pages to the right ones.