Results 1 to 6 of 6
  1. #1
    Devil's Reject Electropulse's Avatar
    Join Date
    January 18th, 2005
    Posts
    987
    so far this month the Inktomi bot has slurped up 39 megs worth of bandwidth on a site that is only about 3megs.

    any one else with this problem?

    "If electricity comes from electrons, does morality come from morons?" -anon

  2. #2
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    1,916

  3. #3
    The "other" left wing davidh's Avatar
    Join Date
    January 18th, 2005
    Location
    Boston
    Posts
    3,492
    Is that a problem?

    To be slurped, or not to be slurped. That is the question.

  4. #4
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    North Carolina
    Posts
    1,026
    For the past 2 months Slurp is eating at least 800-1000 pages each day in my site. Some of them are duplicate reads. I do not see these pages at all in inktomi pure search (through hotbot or others). What are they doing with all these crawls? Anyone seeing this?

  5. #5
    ABW Veteran Student Heyder's Avatar
    Join Date
    January 18th, 2005
    Posts
    5,482
    I have to think the crawls will pay off in the future.

  6. #6
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    North Carolina
    Posts
    1,026
    I hope so too. Question is when is that 'future'?

  7. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Yahoo Slurp
    By Trust in forum Search Engine Optimization
    Replies: 10
    Last Post: February 17th, 2004, 01:27 PM
  2. Slurp?
    By frank3iii in forum Search Engine Optimization
    Replies: 1
    Last Post: September 6th, 2003, 10:20 AM
  3. YahooSeeker / Slurp
    By ellen-s4y in forum Search Engine Optimization
    Replies: 1
    Last Post: September 5th, 2003, 10:12 AM
  4. Where did slurp go?
    By AffiliateBuddha in forum Search Engine Optimization
    Replies: 2
    Last Post: April 17th, 2003, 02:29 PM
  5. Question Inktomi Slurp Spider?
    By Justdoit in forum Search Engine Optimization
    Replies: 1
    Last Post: June 27th, 2002, 05:47 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •