Results 1 to 4 of 4
  1. #1
    Web Ho - Design B!tch ~Michelle's Avatar
    Join Date
    January 18th, 2005
    Location
    Michigan
    Posts
    2,040
    Suggestions Please - RE: Google Images & Zyborg/1.0
    I am having a heck of a problem with google images having my images come up in their image search.

    I have them blocked in my robots.txt file using

    User-agent: Googlebot-Image
    Disallow: /

    and yet they still come. images.google.es, images.google.de, etc. etc. etc.

    The worst part is they are listing images that were never hosted on my site to start with! They followed an affiliate link to an image. For example, I used to have the Video Game Deals feed on my site and their feed included images. Even though I have always had imagebot blocked, it is showing up in my stats as:

    http://images.google.com/imgres?imgurl=http://www.videogamedeals.com/images/devil_may_cry_

    If I click on that in my logs, it goes to Google images and loads up my video game page and says: Below is the image in its original context on the page: www.mysiteurl.com.

    How can I make this stop?


    Also, second problem.... Zyborg/1.0 is eating my site up daily and really chomping on the bandwidth. Because of them I am using at least triple the bandwidth of previous months.

    I added the following to my robots.txt but they are ignoring it.

    User-agent: ZyBorg/1.0
    Disallow: /

    Does anyone have any idea how else I can block this bot?


    TIA!
    ~Michelle
    "All I ask is a chance to prove that money can't make me happy."
    "Work to become, not to acquire." -- Confucius

  2. #2
    Full Member
    Join Date
    January 18th, 2005
    Posts
    224
    Googlebot
    Michelle,
    I went over to Webmaster World to see about blocking images from being indexed. ( I wish they had a good search function) anyway, I found this thread
    http://www.webmasterworld.com/forum93/622.htm

    The basics was how to keep googlebot from indexing php pages.

    I want to make sure that I read this (see below) right. If I use:
    User-agent: Googlebot
    Disallow: /*.php$
    Google will not index any pages that have .php as an extension, correct?
    So, maybe if instead of using
    User-agent: Googlebot-Image
    Disallow: /

    You tried:
    User-agent: Googlebot-Image
    Disallow: /

    User-agent: Googlebot
    Disallow: /images/
    Disallow: /img/
    Disallow: /icons/
    Disallow: /icons/small/
    Disallow: /gallery/
    Disallow: /graphics/
    Disallow: /gfx/
    Disallow: /buttons/
    Disallow: /thumbs/
    Disallow: /thumbnails/
    Disallow: /*.pdf$
    Disallow: /*.ico$
    Disallow: /*.tif$
    Disallow: /*.pict$
    Disallow: /*.png$
    Disallow: /*.gif$
    Disallow: /*.jpg$
    Disallow: /*.jpeg$
    Disallow: /*.doc$
    Disallow: /*.xls$
    Disallow: /*.pps$
    Disallow: /*.ppt$
    Disallow: /*.eml$
    Disallow: /*.url$
    Disallow: /*.log$
    Disallow: /*.txt$
    Disallow: /*.js$
    Disallow: /*.pac$
    Disallow: /*.css$
    Disallow: /*.csv$
    Disallow: /*.ext$
    Disallow: /*.class$
    Disallow: /*.cls$
    Disallow: /*.jar$
    Disallow: /*.java$
    Disallow: /*.c$
    Disallow: /*.htx$
    Disallow: /*.idc$
    Disallow: /*.qry$
    Disallow: /*.wo$
    Disallow: /*.woa$
    Disallow: /*.wos$
    Disallow: /*.lp$
    Disallow: /*.ls$
    Disallow: /*.lsp$
    Disallow: /*.au$
    Disallow: /*.mid$
    Disallow: /*.wav$
    Disallow: /*.avi$
    Disallow: /*.dat$
    Disallow: /*.mov$
    Disallow: /*.mpeg$
    Disallow: /*.mpg$
    Disallow: /*.dir$
    Disallow: /*.dcr$
    Disallow: /*.dxr$
    Disallow: /*.aam$
    Disallow: /*.aas$
    Disallow: /*.aab$
    Disallow: /*.fh$
    Disallow: /*.spl$
    Disallow: /*.swf$
    Disallow: /*.fla$
    Disallow: /*.ipx$
    Disallow: /*.bin$
    Disallow: /*.hqx$
    Disallow: /*.sea$
    Disallow: /*.sit$
    Disallow: /*.dmg$
    Disallow: /*.conf$
    Disallow: /*.plist$
    Disallow: /*.cab$
    Disallow: /*.dll$
    Disallow: /*.exe$
    Disallow: /*.zip$
    Disallow: /*.tar$
    Disallow: /*.gz$
    Disallow: /*.gzip$
    Disallow: /*?
    Disallow: /*.t$
    Disallow: /*.cgi$
    Disallow: /*.pl$
    Disallow: /*.plx$
    Disallow: /*.pm$
    Disallow: /*.py$
    Disallow: /*.pyc$

    If that would work? I'm curious about this, also.
    "Whether you think you can, or whether you think you can't...You're right!" -Henry Ford-

  3. #3
    ABW Ambassador DesignerWiz's Avatar
    Join Date
    January 18th, 2005
    Location
    U.S.A
    Posts
    2,777
    Hi Michelle,

    There are many webmasters concerned about the Zyborg bot lately.

    Here's some information I found.

    Zyborg/1.0
    Mozilla/4.0 compatible ZyBorg/1.0 (wn-12.zyborg@looksmart.net; http://www.WISEnutbot.com)
    A bot used to spider your website for inclusion into the Wisenut search.

    You could contact Wisenut and ask them directly.
    Contact: http://www.wisenutbot.com/corp/contact.html

    Some useful information & tool resources:
    http://www.neilgunton.com/spambot_trap/

    Take a look at the badhosts_loop script at Neils site (about 1/3 way down the page) ... it works very nicely at monitoring/blocking bot actions.
    Ray Thomas
    Webmaster Resources: http://DesignerWiz.com
    ABW Board Category: Programming / Coding
    http://forum.abestweb.com/forumdisplay.php?f=190

  4. #4
    Web Ho - Design B!tch ~Michelle's Avatar
    Join Date
    January 18th, 2005
    Location
    Michigan
    Posts
    2,040
    Thanks Ray! I will check that out.
    ~Michelle
    "All I ask is a chance to prove that money can't make me happy."
    "Work to become, not to acquire." -- Confucius

  5. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Google Search Using Images
    By markwelch in forum Search Engine Optimization
    Replies: 6
    Last Post: July 7th, 2011, 02:16 PM
  2. Google Images
    By boningroup in forum Midnight Cafe'
    Replies: 14
    Last Post: September 7th, 2009, 10:26 AM
  3. New Merchant Needs Your Inputs & Suggestions
    By goldfishboy in forum ShareASale - SAS
    Replies: 14
    Last Post: January 26th, 2009, 07:02 PM
  4. Google AdSense Now with Images
    By eMerchantConsulting in forum Midnight Cafe'
    Replies: 12
    Last Post: May 13th, 2004, 06:33 AM
  5. Suggestions for the Open Q&A™
    By Haiko de Poel, Jr. in forum Midnight Cafe'
    Replies: 6
    Last Post: January 13th, 2002, 02:20 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •