Results 1 to 4 of 4
  1. #1
    Newbie
    Join Date
    January 18th, 2005
    Posts
    9
    Hi - I'm in the process of putting together a site with many static pages rather than dbase-driven stuff. Files may eventually be over 1 Million.

    Now I know an easy way to implement search into a site is to use SQL search, but I'm wondering if any of you know how to best implement search for such a large number of static pages.

    The key, of course, is to make the search run quickly despite the large number of files.

    I'm open to any options, as I've got a Linux server, a Windows box and a dedicated dbase server.

    Perhaps Perl/CGI would be most effective?

    I just don't know, but if there's something "out of the box," I'd much prefer that to having to do contract out a custom development project.

    Any help/suggestions appreciated.

    Thanks,
    ~Bleddyn

  2. #2
    ABW Ambassador buy_online's Avatar
    Join Date
    January 18th, 2005
    Location
    Richmond, VA
    Posts
    3,234
    Try HtDig. I use it, and it is really well suited for a site such as yours. Will run well on Linux. Searches are really quite fast. This is an open-source product, and is Free, and comes in an "out of the box" form, requiring very little customization.

    Only downside is that after indexing your site(s) it will create some very large files, so have some extra storage available. For your site size, we're talking about 500 - 700 MB (for everything).

    If you have a hosted solution, make sure your provider offers shell access.

    http://htdig.org

    Good luck,

    Fred

    You might just be a Redneck if - Birds are attracted to your beard...

  3. #3
    Newbie
    Join Date
    January 18th, 2005
    Posts
    9
    Thanks very much buy_online - I'm looking over the site now...luckily I've got 12 GB free on the Linux box.

    Thanks again...

    ~Bleddyn

  4. #4
    ABW Ambassador buy_online's Avatar
    Join Date
    January 18th, 2005
    Location
    Richmond, VA
    Posts
    3,234
    Cool!

    You can customize the types of searches, the results, and even the search algorythms used. Because this is a true search engine, it uses it's own list, and is quite fast.

    Fred

    You might just be a Redneck if - Birds are attracted to your beard...

  5. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. WordPress 3 for static web site (WP Pages)
    By Lanny in forum Blogging, Mobile and Social Media
    Replies: 7
    Last Post: August 24th, 2010, 02:36 PM
  2. my site search engine stauration pages are decreasing ?
    By istham in forum Search Engine Optimization
    Replies: 5
    Last Post: June 12th, 2008, 05:04 AM
  3. Update static pages?
    By cbgaloot in forum Programming / Datafeeds / Tools
    Replies: 6
    Last Post: February 24th, 2005, 02:31 PM
  4. Dynamic Pages vs. Static Pages or Redirects?
    By Cagles Mill in forum Programming / Datafeeds / Tools
    Replies: 9
    Last Post: March 10th, 2004, 11:43 AM
  5. php static pages
    By awstewar in forum Programming / Datafeeds / Tools
    Replies: 1
    Last Post: July 15th, 2003, 12:10 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •