Results 1 to 6 of 6
  1. #1
    Full Member Zdig's Avatar
    Join Date
    February 26th, 2005
    Posts
    274
    Removing specific file type - robots.txt
    I've been trying to remove all .gif files from the Google index for one of my sites. I have tried adding the following to my robots.txt with no success after several weeks and many visits from googlebot.

    User-agent: Googlebot
    Disallow: /*.gif

    I'm no seo guru...any advice anyone? Does this type of thing typically take months or longer or something?

  2. #2
    Member kmkimmo's Avatar
    Join Date
    January 18th, 2005
    Location
    Texas Coast
    Posts
    133
    I am no expert on this, but my understanding is that you cannot use regular expression symbols for exclusions in robots.txt.

    So the /*.gif is invalid.

    My best guess is that you would have to put your images in a separate directory and then exclude that directory in robots.txt - that's a bit of a pain if you already have your site set up, but it would work.
    - I am not young enough to know everything

  3. #3
    ABW Ambassador MoneyBusiness's Avatar
    Join Date
    March 14th, 2006
    Posts
    2,051
    Haven't worked much with robots.txt, but was doing some research into your questions. See if this helps:

    http://alicorna.com/content/view/15/46/

  4. #4
    Affiliate Manager MINDsprinter's Avatar
    Join Date
    August 18th, 2006
    Location
    Washington, DC
    Posts
    1,436
    I don't think you can do that kind of the with robots.txt

    However, if you keep all your images in one folder like a good webmaster, then you can just disallow the folder!
    Jason Rosenbaum
    Affiliate Manager
    MINDsprinting

  5. #5
    Full Member Zdig's Avatar
    Join Date
    February 26th, 2005
    Posts
    274
    Quote Originally Posted by MINDsprinter
    I don't think you can do that kind of the with robots.txt

    However, if you keep all your images in one folder like a good webmaster, then you can just disallow the folder!
    pretty sure you can: http://www.google.com/support/webmas...y?answer=35303

    "To remove all files of a specific file type (for example, .gif), you'd use the following robots.txt entry:

    User-agent: Googlebot
    Disallow: /*.gif$"

  6. #6
    Affiliate Manager MINDsprinter's Avatar
    Join Date
    August 18th, 2006
    Location
    Washington, DC
    Posts
    1,436
    ooo, cool. I didn't know that. Thanks!
    Jason Rosenbaum
    Affiliate Manager
    MINDsprinting

  7. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Looking for a Good Robots.txt file
    By Doug247 in forum Midnight Cafe'
    Replies: 8
    Last Post: July 24th, 2007, 06:18 PM
  2. editing Robots.txt file
    By KODea in forum Search Engine Optimization
    Replies: 5
    Last Post: August 28th, 2006, 03:02 PM
  3. robots.txt file
    By UncleScooter in forum Midnight Cafe'
    Replies: 2
    Last Post: October 15th, 2004, 06:39 PM
  4. Do I need a "robots.txt" file?
    By unclejesse in forum Search Engine Optimization
    Replies: 20
    Last Post: June 12th, 2004, 11:02 AM
  5. robots.txt file????? HELP
    By john dundas in forum Search Engine Optimization
    Replies: 4
    Last Post: August 18th, 2002, 05:36 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •