Results 1 to 3 of 3
  1. #1
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    Reno, NV
    Posts
    856
    Hi,

    I have a new site. It has been spidered by Google, Fast Search and Alta Vista without problems (just beginning to show up in the AV and Fast Search indexes - still not yet in Google for some reason). Inktomi (identified in the logs as "Slurp") visits my site almost daily - but never makes it beyond the home page. None of the other spiders are having this problem - so why is Inktomi stopping at my home page and proceeding no further?

    Also, does Alexa.Com have a spider? I have recently been getting visits from them.

    Same thing with Looksmart. Do they have a spider - my site is listed in Looksmart but the bulk of the visits are from zyborg@looksmart.net. Is this Zyborg a spider??

    Thanks.

    Jim

    www.bigskyfishing.com

  2. #2
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    1,916
    yes yes and yes

    Ink has a pay for spidering program, you can pay for the pages you want spidered..otherwise you can wait..u may get deep crawled u may not...

    Is fast going deep into your site?

  3. #3
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    Reno, NV
    Posts
    856
    Yes, Fast seems to be going deep into my site. Not entirely sure how deep right now, as it just popped up in the Fast index last week (Fast was still spidering my site when it showed up in its index at AlltheWeb). But Fast was at my site for quite sometime and it wasn't uncommon for it to view 100+ pages a day while it was there. So, got my fingers crossed that it indexed most of my pages. Right now, at AlltheWeb, only my top two levels (54 in total) got indexed.

  4. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Questions about Affiliate Engine.
    By dkbtech in forum Cusimano.com Scripts
    Replies: 3
    Last Post: September 6th, 2005, 05:04 PM
  2. In Search Of A Site Search Engine Spider
    By Heidi in forum Midnight Cafe'
    Replies: 2
    Last Post: September 19th, 2002, 07:13 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •