Results 1 to 5 of 5
  1. #1
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    1,916
    Been seeing a lot of crawling from cadabra.com
    Wtf are they up to? First they hit
    /robots.txt and /
    then all of my overture PPC links (can tell from the source tag), then began what looks like a deep crawl over the next few days.
    www.cadabra.com redirects to overture.

    Also, their crawler seems somewhat broken, as I have some 301's on this site which redirect offsite and they're not properly following the redirect. They're doing another GET of the same URI and then appending the target URL.. sorry if I'm not explaining that correctly.

    Anyone else seeing this too?

    J

  2. #2
    ABW Adviser Panel Dynamoo's Avatar
    Join Date
    January 18th, 2005
    Location
    Opposite the Slough of Despond
    Posts
    5,465
    cadabra.com is aka "GoTo Comparison Shopping" which looks like it vanished from the Overture stables. That was an acquisition made back in 1999, so it's ancient history really.

    Useless fact gleaned from the web.. Jeff Bezos was originally going to call that online bookshop thingie Cadabra.com but changed it to Amazon.

    I still get access hits from dec.com (i.e. HP/Compaq) so some of these domains continue to be used internally for several years after the original company is defunct.

  3. #3
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    1,916
    Ahhhh! I see. Thanks for the info.

    So basically overture is deep crawling?

    Is that standard? (Only recently started with some overture PPC)

  4. #4
    ABW Adviser Panel Dynamoo's Avatar
    Join Date
    January 18th, 2005
    Location
    Opposite the Slough of Despond
    Posts
    5,465
    Well the odd thing is that Inktomi are meant to provide the results (I thought) so I'm not certain it's a crawler.

    Maybe its some sort of site checking tool they use?

  5. #5
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    1,916
    Maybe. But they seem to be crawling the entire site, not just pages listed at overture..

    Thats what I thought too..that the non paid results were from INK, so why are they crawling... just curious. [img]/infopop/emoticons/icon_smile.gif[/img]

  6. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Google just crawled my page.
    By munky in forum Search Engine Optimization
    Replies: 10
    Last Post: April 27th, 2008, 08:46 PM
  2. Google just crawled my page.
    By munky in forum Building Traffic, Newsletters & Advertising
    Replies: 2
    Last Post: April 19th, 2008, 06:02 PM
  3. Anyone else is getting crawled by:
    By Mr. Sal in forum Midnight Cafe'
    Replies: 4
    Last Post: April 19th, 2007, 05:30 PM
  4. Getting crawled by Google
    By Jim_W in forum Search Engine Optimization
    Replies: 1
    Last Post: August 4th, 2003, 09:42 AM
  5. Google only crawled 2 pages!?
    By Cyberfire in forum Search Engine Optimization
    Replies: 5
    Last Post: June 2nd, 2003, 01:13 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •