Results 1 to 9 of 9
  1. #1
    Web Ho - Design B!tch ~Michelle's Avatar
    Join Date
    January 18th, 2005
    Location
    Michigan
    Posts
    2,040
    Help with a couple problems please
    I posted this in the search engine forum the other day, but it has received no response, so I thought I would try in here.

    I am having a heck of a problem with google images having my images come up in their image search.

    I have them blocked in my robots.txt file using

    User-agent: Googlebot-Image
    Disallow: /

    and yet they still come. images.google.es, images.google.de, etc. etc. etc.

    The worst part is they are listing images that were never hosted on my site to start with! They followed an affiliate link to an image. For example, I used to have the Video Game Deals feed on my site and their feed included images. Even though I have always had imagebot blocked, it is showing up in my stats as:

    http://images.google.com/imgres?imgurl=http://www.videogamedeals.com/images/devil_may_cry_

    (It is also doing this on another site of mine where the merchant provides the image though a datafeed link)

    If I click on that in my logs, it goes to Google images and loads up my video game page and says: Below is the image in its original context on the page: www.mysiteurl.com.

    How can I make this stop?


    Also, second problem.... Zyborg/1.0 is eating my site up daily and really chomping on the bandwidth. Because of them I am using at least triple the bandwidth of previous months.

    I added the following to my robots.txt but they are ignoring it.

    User-agent: ZyBorg/1.0
    Disallow: /

    Does anyone have any idea how else I can block this bot?
    ~Michelle
    "All I ask is a chance to prove that money can't make me happy."
    "Work to become, not to acquire." -- Confucius

  2. #2
    lurk
    Join Date
    March 25th, 2005
    Posts
    355
    You can always block the servers IP address where the bot is coming from. Don't know what ZyBorg is, but if they are only eating up bandwidth from an image search, it should be fine.

  3. #3
    Chick with Brains Tracy's Avatar
    Join Date
    January 18th, 2005
    Location
    Polk County, Florida
    Posts
    1,878
    Yesterday I added the code in this thread to the top of my pages:

    http://forum.abestweb.com/showthread.php?t=57488

    It won't stop people from coming to your site from the google images pages, but it does remove the google frame and puts them on your site. The cool thing about this, is when people hit the back button it doesn't work. They can't go back to the Google site.

    I really love this script! The way I look at it. Sometimes people are actually looking for a product when they click on a google image link. It's just more traffic to my site and another chance for a sale.

  4. #4
    Full Member
    Join Date
    January 18th, 2005
    Posts
    224
    michelle
    I posted a reply on the thread http://forum.abestweb.com/showthread.php?t=57502

    Still looking for the Zyborg bot. I did find some interesting threads on Google on how to set up a honeypot and trap a bot that ignores the robots file.

    If I find a good one, I'll let you know!

    I'm interested in this stuff myself. Whenever I discover a problem and possible solution, it gets saved on disc.

    I'm still looking for the thread about stopping 302 redirects.
    Last edited by Rick K.; April 29th, 2005 at 01:54 AM. Reason: misspelling
    "Whether you think you can, or whether you think you can't...You're right!" -Henry Ford-

  5. #5
    Full Member
    Join Date
    January 18th, 2005
    Posts
    224
    Michelle,
    Zyborg 1.0 is the Wisenut bot, which is another search engine. http://www.wisenutbot.com/

    ZyBorg/1.0 (ZyBorg@WISEnut.com; http://www.WISEnut.com)

    List of bots at http://www.psychedelix.com/agents.html

    Still looking for a good "honeypot" trap. There's a 25 page thread over at WW dealing with .htaccess and bots - http://www.webmasterworld.com/forum13/687.htm

    See if all this helps.
    "Whether you think you can, or whether you think you can't...You're right!" -Henry Ford-

  6. #6
    Web Ho - Design B!tch ~Michelle's Avatar
    Join Date
    January 18th, 2005
    Location
    Michigan
    Posts
    2,040
    Quote Originally Posted by Rick K.
    Michelle,
    Zyborg 1.0 is the Wisenut bot, which is another search engine. http://www.wisenutbot.com/

    ZyBorg/1.0 (ZyBorg@WISEnut.com; http://www.WISEnut.com)

    List of bots at http://www.psychedelix.com/agents.html

    Still looking for a good "honeypot" trap. There's a 25 page thread over at WW dealing with .htaccess and bots - http://www.webmasterworld.com/forum13/687.htm

    See if all this helps.

    I knew that ZyBorg had to do with WISEnut, but my logs show it as the following:

    Agent: Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com)

    So is this a regular indexing, or is it looking for Dead Links?

    Thanks to everyone for your suggestions so far. I wish I could figure out why Google image is not paying attention to the robots.txt. It is frustrating to have them including images that aren't even on my site and the only way someone gets to them is to click on the links I described above.
    ~Michelle
    "All I ask is a chance to prove that money can't make me happy."
    "Work to become, not to acquire." -- Confucius

  7. #7
    notary sojac Herb ԿԬ's Avatar
    Join Date
    January 18th, 2005
    Location
    Central/Western NY State
    Posts
    7,741
    >>>Dead Link Checker

    I wonder . . . I get an email once in a while from some place saying I have a dead link somewhere and offering me a service that will scan my site(s) for a fee to check and report on dead links.

    If they are going to push up a hosting bill for usage, we don't need them.

  8. #8
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    Texas, USA
    Posts
    579
    Arrow Knock On Wood


    Hi, ~Michelle,

    I had trouble on my web site a short while back with some bot from China pounding my web site like a crazed woodpecker on speed.

    My web site is on a Apache web server. I traced the IP number (nnn.nnn.nnn.nnn) of this crazed bot through my Latest Visitor log. I then entered the IP number in my IP Deny Manager. That stopped the crazed bot for a while but it then popped again up using another IP#.

    I repeated the process. I listed the second IP# in my IP Deny manager. I have seen no more crazed bots from China since. (Knock on wood).

    Best,

    RadarCat, Webmaster
    http://www.os2warplinks.com

  9. #9
    Web Ho - Design B!tch ~Michelle's Avatar
    Join Date
    January 18th, 2005
    Location
    Michigan
    Posts
    2,040
    Quote Originally Posted by RadarCat


    Hi, ~Michelle,

    I had trouble on my web site a short while back with some bot from China pounding my web site like a crazed woodpecker on speed.

    My web site is on a Apache web server. I traced the IP number (nnn.nnn.nnn.nnn) of this crazed bot through my Latest Visitor log. I then entered the IP number in my IP Deny Manager. That stopped the crazed bot for a while but it then popped again up using another IP#.

    I repeated the process. I listed the second IP# in my IP Deny manager. I have seen no more crazed bots from China since. (Knock on wood).

    Best,

    RadarCat, Webmaster
    http://www.os2warplinks.com


    Thank you! I will give that a try.
    ~Michelle
    "All I ask is a chance to prove that money can't make me happy."
    "Work to become, not to acquire." -- Confucius

  10. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. got a couple of questions
    By tufpup in forum Newbie Affiliate FAQs & Helpful Articles
    Replies: 3
    Last Post: March 21st, 2011, 01:41 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •