Results 1 to 17 of 17
  1. #1
    Devil's Reject Electropulse's Avatar
    Join Date
    January 18th, 2005
    Posts
    987
    Angry Scraper sites...
    I was doing a search for my domain, "domain.com" and the first few serps are genuine links to me, but the next 20 serps were full of scraper sites...

    my question is: how the hell do I ban these motherf'ers from crawling my site?

  2. #2
    .
    Join Date
    January 18th, 2005
    Posts
    2,973
    If you can identify the IP address (or range) that the spiders are coming from, you may be able to configure your server to ignore requests from those IP addresses. (I've done this with Microsoft IIS, with some success.)

  3. #3
    Moderator Nabz's Avatar
    Join Date
    August 24th, 2005
    Location
    VY Canis Majoris
    Posts
    1,751
    I have many websites, and since I have good positions on both Google and MSN, a lot of scrapper sites link my websites. Generally I don't have any problem, because it will not harm my ranking.

  4. #4
    notary sojac Herb ԿԬ's Avatar
    Join Date
    January 18th, 2005
    Location
    Central/Western NY State
    Posts
    7,741
    Lightbulb
    do you think people are looking at the parked domains running google-provided software and calling them scrapers also?

  5. #5
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    744
    Scraper sites S*CK! Theoretically, they shouldn't harm your ranking (just because they link to you). But they really clog up the search results. I am astounded at the quantity of search results I see in Google and Yahoo that are nothing more than scraper sites with AdWords. YUCK! I want the searche engines to get rid of them!

  6. #6
    ABW Ambassador Snib's Avatar
    Join Date
    January 18th, 2005
    Location
    Virginia
    Posts
    5,303
    Are you sure they're scraping your site? Most scraper sites I've seen scrape their results from Yahoo's search results. In which case you can't do anything to block them without dropping out of Yahoo's results.

    - Scott
    Hatred stirs up strife, But love covers all transgressions.

  7. #7
    pph Expert! Gordon's Avatar
    Join Date
    January 18th, 2005
    Location
    Edmonton Canada
    Posts
    5,781
    Dont forget if these scraper guys are running their scripts from their own computers (on genuine IP's like Bell and Shaw cable) and you have a script on your server to ban them you risk banning an awful lot of genuine customers as well. I've checked through some of the IP's my script banned and found some big names so I potentialy banned an awful lot of potential customers until I realised.
    One day parasites and their ilk will be made illegal, I bet a few Lawyers will be pissed off when the day comes.
    Mr. Spitzer is fetching it nearer

    YouTrek

  8. #8
    More Cheesier Than Ever Cheesehead's Avatar
    Join Date
    January 18th, 2005
    Location
    Land of The NFL Champs!
    Posts
    2,942
    I am starting to get link-exchange requests from scraper sites saying they "can no longer find the reciprocal link to their site" when in fact they scraped my link. In some cases their link page is not even indexed so I am thinking that times are starting to get rough for the scrapers.
    This World is Not My Home
    We're gonna go inside, we're gonna go outside, inside and outside. . . And then we're gonna go go go and we're not gonna stop til we get across that goalline! Quotes from the movie Rudy, 1993

  9. #9
    2005 Linkshare Golden Link Award Winner  ecomcity's Avatar
    Join Date
    January 18th, 2005
    Location
    St Clair Shores MI.
    Posts
    17,328
    Let's OUT some of the scraper sites rather then complain about them. Here's a site scraping wank operating out of NYC. He owns many scraped domains trying to name then to get SERP results ..see sample below.

    http://www.falxsuspenders.com/

    Cory Quigly
    64174 8th Avenue
    New York, NY 10157
    US

    Domain Name: FALXSUSPENDERS.COM

    Administrative Contact:
    Cory Quigly Cory202242@shaw.ca
    Cory Quigly
    64174 8th Avenue
    New York, NY 10157
    US
    Phone: 2125187278
    Fax: 2129955621
    Technical Contact:
    Cory Quigly Cory202242@shaw.ca
    Cory Quigly
    64174 8th Avenue
    New York, NY 10157
    US
    Phone: 2125187278
    Fax: 2129955621
    Billing Contact:
    Cory Quigly Cory202242@shaw.ca
    Cory Quigly
    64174 8th Avenue
    New York, NY 10157
    US
    Phone: 2125187278
    Fax: 2129955621

    Record updated on 2006-01-08 01:59:37
    Record created on 2006-01-08
    Record expires on 2007-01-08
    Database last updated on 2006-02-06 14:46:29 EST

    Domain servers in listed order:

    NS1.CUTBACKGROUND.COM 147.202.90.41
    NS2.CUTBACKGROUND.COM 147.202.90.42
    Webmaster's... Mike and Charlie

    "What have you done today to put real value into a referral click...from a shoppers viewpoint!"

  10. #10
    ABW Ambassador mailman's Avatar
    Join Date
    January 18th, 2005
    Location
    mailordering.com
    Posts
    906
    Shaw Cable is a Canadian cable company. How does he get a US address in Ny?

  11. #11
    2005 Linkshare Golden Link Award Winner  ecomcity's Avatar
    Join Date
    January 18th, 2005
    Location
    St Clair Shores MI.
    Posts
    17,328
    Quote Originally Posted by mailman
    Shaw Cable is a Canadian cable company. How does he get a US address in Ny?
    He runs scraper sites so the address is probably as phoney as his name.
    Webmaster's... Mike and Charlie

    "What have you done today to put real value into a referral click...from a shoppers viewpoint!"

  12. #12
    Newbie
    Join Date
    January 18th, 2005
    Posts
    511
    its not going to harm your site so stop *****ing and just get on with making money or doing your online hobby

  13. #13
    Devil's Reject Electropulse's Avatar
    Join Date
    January 18th, 2005
    Posts
    987
    Quote Originally Posted by Lasthope
    its not going to harm your site so stop *****ing and just get on with making money or doing your online hobby
    of course it seems to be harming something, didn't google kick a whole bunch of them out not so long ago?

    some people here don't like scraper sites, including myself

    besides, as a adwords advertiser I don't think I want sites that steal my content and make money off my ads at the same time...

  14. #14
    2005 Linkshare Golden Link Award Winner  ecomcity's Avatar
    Join Date
    January 18th, 2005
    Location
    St Clair Shores MI.
    Posts
    17,328
    Anyone scraping other sites content to hawk Adwords paid exits is an unethical piece of crap. They can scrape and resell the peanuts out of poop before they get my respect.
    Webmaster's... Mike and Charlie

    "What have you done today to put real value into a referral click...from a shoppers viewpoint!"

  15. #15
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    Nunya, Business
    Posts
    23,684
    Electropulse, I wouldn't put too much into what Lasthope says about scraping and things of that nature:

    http://forum.abestweb.com/showthread...166#post177166

  16. #16
    Full Member
    Join Date
    January 18th, 2005
    Posts
    396
    Just as an aside - I see that about 25% of my traffic comes from sites I've never heard of - when I visit them, they consist of a jumble of links that must have mine buried in there somewhere (scraper sites??)

  17. #17
    Comfortably Numb John Powell's Avatar
    Join Date
    October 17th, 2005
    Location
    Bayou Country, LA
    Posts
    3,432
    Quote Originally Posted by Ecomcity
    Here's a site scraping wank operating out of NYC.
    Man you should have warned me to hold my nose before clicking that link.

    Quote Originally Posted by Electropulse
    doing a search for my domain, "domain.com"
    Well I see where Overture is letting my adds be displayed. Many sites that are pure sponsored links with zero content.


  18. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Featured: Google Says Submit Scraper Sites That Outrank You
    By JCrooks - AffiliateWindow in forum Search Engine Optimization
    Replies: 9
    Last Post: June 5th, 2014, 01:32 PM
  2. Real time forum scraper
    By Robocop in forum Midnight Cafe'
    Replies: 9
    Last Post: August 29th, 2012, 02:02 PM
  3. super scraper?
    By Herb ԿԬ in forum Midnight Cafe'
    Replies: 2
    Last Post: October 10th, 2008, 12:00 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •