Results 1 to 16 of 16
  1. #1
    Newbie zibinet's Avatar
    Join Date
    July 19th, 2010
    Location
    Ottawa, Canada
    Posts
    11
    data mining
    Hello,

    How do merchant sites feel about automated data gathering? Ex. I use a program to go and find me content from merchant sites, then I filter through it and post the ones I like to my site. Could be airfare, hotels, retail, etc.

    Thanks,
    Marek

  2. #2
    Full Member iolaire's Avatar
    Join Date
    October 3rd, 2006
    Location
    Arlington, VA
    Posts
    229
    I think most merchants will have policy's forbidding it, so you run the risk of them getting mad if they find you doing it.

    For example Hilton.com's Site Usage Agreement linked to from the bottom of homepage:
    XII. ACCESS AND INTERFERENCE

    You will not use any robot, spider, other automatic device, or manual process to monitor or copy the Site or the contents or information (including the Information) contained therein without our prior express written consent. You agree that you will not use any device, software or routine to interfere or attempt to interfere with the proper working of the Site or any transaction being conducted through the Site. You agree that you will not copy, reproduce, alter, modify, create derivative works, or publicly display any content (except for any Information in which you have an ownership interest) from the Site without our prior express written consent or the appropriate third party.

  3. #3
    Affiliate Manager Resume Companion's Avatar
    Join Date
    May 6th, 2010
    Location
    Maryland/DC/VA
    Posts
    83
    yea whats the point of doing that? since you got to get the affiliate links/banners in order to make any money anyways. unless you are doing adsense? then u are profiting off their content, which im sure they wont like very much.
    Howard Chai, Affiliate Manager
    Email: [email]affiliate@resumecompanion.com[/email]
    Website: [URL="http://resumecompanion.com"]ResumeCompanion.com[/URL]
    SAS Program Link: [URL="http://www.shareasale.com/shareasale.cfm?merchantID=26342"]Join Now[/URL]

  4. #4
    Newbie zibinet's Avatar
    Join Date
    July 19th, 2010
    Location
    Ottawa, Canada
    Posts
    11
    Quote Originally Posted by Resume Companion View Post
    yea whats the point of doing that? since you got to get the affiliate links/banners in order to make any money anyways. unless you are doing adsense? then u are profiting off their content, which im sure they wont like very much.
    I was thinking of being an affiliate for airlines, using *iMacros to automatically get airfare prices for specific flights daily and showing the best ones on my website (show a link to airline site, price/date of fare, form parameters to get fare). Then collecting commission should someone click to go to the airline site and buy a ticket.

    *iMacros is an extension for the Mozilla Firefox web browsers, Google Chrome and Internet Explorer which adds record and replay functionality similar to that found in web testing and form filler software

    So the verdict is that airline sites would not like this?

  5. #5
    http and a telephoto
    Join Date
    January 18th, 2005
    Location
    NYC
    Posts
    17,708
    As noted above, it is against the TOS of most merchants, no they won't like it.
    Deborah Carney
    TeamLoxly.com BookGoodies.com ABCsPlus.com

  6. #6
    Newbie zibinet's Avatar
    Join Date
    July 19th, 2010
    Location
    Ottawa, Canada
    Posts
    11
    Quote Originally Posted by loxly View Post
    As noted above, it is against the TOS of most merchants, no they won't like it.
    That TOS is geared towards regular users though. Wouldn't they be different for an affiliate?

  7. #7
    http and a telephoto
    Join Date
    January 18th, 2005
    Location
    NYC
    Posts
    17,708
    Quote Originally Posted by zibinet View Post
    That TOS is geared towards regular users though. Wouldn't they be different for an affiliate?
    No. Those are in a lot of merchant Terms of Service. That is why they provide datafeeds and coupon feeds. If you scrape a site you are using their server resources and most sites will actually block your script.
    Deborah Carney
    TeamLoxly.com BookGoodies.com ABCsPlus.com

  8. #8
    More Cheesier Than Ever Cheesehead's Avatar
    Join Date
    January 18th, 2005
    Location
    Land of The NFL Champs!
    Posts
    2,942
    To get your answer, ask the merchant and explain exactly what you propose to do. We can not speak for the merchant. Who knows, maybe they allow it. Although probably not. Before you ask, carefully read the terms.
    This World is Not My Home
    We're gonna go inside, we're gonna go outside, inside and outside. . . And then we're gonna go go go and we're not gonna stop til we get across that goalline! Quotes from the movie Rudy, 1993

  9. #9
    Affiliate Manager Resume Companion's Avatar
    Join Date
    May 6th, 2010
    Location
    Maryland/DC/VA
    Posts
    83
    yea its a novel idea but youll also be at the whim of the merchants. for the amount of coding and effort it takes to pull off what you are talking about, there are probably better ways to go about it. just imo
    Howard Chai, Affiliate Manager
    Email: [email]affiliate@resumecompanion.com[/email]
    Website: [URL="http://resumecompanion.com"]ResumeCompanion.com[/URL]
    SAS Program Link: [URL="http://www.shareasale.com/shareasale.cfm?merchantID=26342"]Join Now[/URL]

  10. #10
    ABW Ambassador 2busy's Avatar
    Join Date
    January 17th, 2005
    Location
    Tropical Mountaintop
    Posts
    5,636
    That TOS is geared towards regular users though. Wouldn't they be different for an affiliate?
    On the merchant's site there are terms that apply to "regular users" of their site. When you apply to be an affiliate of those same merchants there is an entirely different TOS that you must agree to and abide by before being accepted into their affiliate program. That is the TOS that is being referred to here.

  11. #11
    http and a telephoto
    Join Date
    January 18th, 2005
    Location
    NYC
    Posts
    17,708
    Bottom line is you need to ask each merchant before doing it. Like I said, your bot is likely to get IP blocked if you are scraping the merchant's site daily.

  12. #12
    Full Member iolaire's Avatar
    Join Date
    October 3rd, 2006
    Location
    Arlington, VA
    Posts
    229
    Quote Originally Posted by zibinet View Post
    I was thinking of being an affiliate for airlines
    As you probably know there is an industry around this - Kayak.com etc.. the word for what they are doing is "metasearch" (http://www.usatoday.com/travel/colum...grossman_x.htm).

    Kayak.com has an API, it used to be limited to 500 or 1,000 queries per day, its a little hidden these days, the URL is:
    http://www.kayak.com/labs/api/search/

    Back in the day I worked on a site using the Kayak API. I sort of lost interest in in, for one reason because I'd need 50,000+ queries each day and I doubted I could get it approved by Kayak.com with no traffic.

    At some point Kayak mentioned up their participation in a metasearch trade group or standards organization. I've tried to find it via a Goggle search a few times and have not been able to find it.

    Otherwise the official route to do such a thing is probably something like:
    http://www.amadeus.com/amadeus/x38251.html

    Read this article:
    http://www.nytimes.com/2010/02/21/travel/21Prac.html
    Kayak, Fly and another meta-search site, Bing Travel from Microsoft, all work with ITA Software for certain search capabilities and access to fares. ITA pulls fares from the Airline Tariff Publishing Company, which collects prices from 500 airlines worldwide. That means many of the meta-search sites are dipping into the same pool of data.

  13. #13
    ABW Ambassador
    Join Date
    February 28th, 2005
    Posts
    574
    almost all of the travel related merchants provide some kind of "live feeds" (webservice/APIs etc)

    you would need to contact each of them asking 1st whether they have such service and 2nd whether they are going to "give you" access to it.

    take in mind that the above is the easy part, as i am involved in this area (travel metasearch) there is more than just take the APIs/webserice ... a hell more than that and you would need to either have experience yourself or find the necessary "know how" in order to move onwards.

  14. #14
    ABW Ambassador kaizen's Avatar
    Join Date
    January 18th, 2005
    Location
    Canada
    Posts
    666
    spam
    We did not change as we grew older; we just became more clearly ourselves.
    ~Lynn Hall

  15. #15
    ABW Ambassador 2busy's Avatar
    Join Date
    January 17th, 2005
    Location
    Tropical Mountaintop
    Posts
    5,636
    just click the little red triangle in the upper right. Yes, you too can report spammers.

  16. #16
    ABW Ambassador kaizen's Avatar
    Join Date
    January 18th, 2005
    Location
    Canada
    Posts
    666
    I have been... seeing if this works
    We did not change as we grew older; we just became more clearly ourselves.
    ~Lynn Hall

  17. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Very nice sale at Black Cat Mining
    By Sue in forum ShareASale - SAS
    Replies: 9
    Last Post: May 23rd, 2008, 03:49 PM
  2. Clickstream/Data Mining Applications
    By RadarCat in forum Midnight Cafe'
    Replies: 7
    Last Post: August 14th, 2004, 11:31 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •