Results 1 to 3 of 3
  1. #1
    Full Member
    Join Date
    January 18th, 2005
    Posts
    416
    Looks like inktomi decided to let slurp follow and index the links with ?s in them after all.

    They were falling behind the search technology by not doing so, as most of the data, nowadays, are served from databases, which makes a lot of economical sense as it is a definite "MUST" for all e-commerce companies to serve their data directly from the database, as opposed to statically binding the data into text/html files.

    FAST should be next.

    -BluesX

  2. #2
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    United Kingdom
    Posts
    1,797
    Blues,

    Fast has indexed dynamic URLs for some time now. There are still issuea with it for deep-crawling spiders, but with paid inclusion and trusted feed, it hasn't been a significant issue for a while.

  3. #3
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    United Kingdom
    Posts
    1,797
    Fast does index dynamic pages on free crawls and has done for a while; in fact, I think they were the first SE to be able to do it.

    As for slurp - you might well be right there.

  4. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Dynamic Landing Pages ?
    By stevegent in forum Midnight Cafe'
    Replies: 1
    Last Post: March 20th, 2007, 02:10 AM
  2. Dynamic Pages vs. Static Pages or Redirects?
    By Cagles Mill in forum Programming / Datafeeds / Tools
    Replies: 9
    Last Post: March 10th, 2004, 11:43 AM
  3. Do SE's Like Static or Dynamic Pages Best?
    By midnightcoder in forum Search Engine Optimization
    Replies: 2
    Last Post: June 17th, 2003, 01:54 PM
  4. Inktomi / Subdirectory pages
    By deelz in forum Search Engine Optimization
    Replies: 8
    Last Post: June 27th, 2002, 07:34 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •