Results 1 to 2 of 2
January 24th, 2004, 08:35 AM #1
- Join Date
- January 18th, 2005
Seems Inktomi decided that my pages were worth looking at.. it now goes further than just hitting robots.txt and has checked out about 4 pages.
that's over 2 days :P fairly slow spider.
I read that when you pay for inclusion for a page on your site.. then tell the spider to fetch a different page then your first designated page is dropped from the index and the spider concentrates on the new one.
If you do not renew pay for inclusion and your page(s) get dropped.. has there been any problems getting inktomi to come along and index any previously paid pages for free?
January 24th, 2004, 09:14 AM #2
I dont pay for inclusion for any reasons...
take Inktomi for example.. I have one site that has 5000 hits from the Inktomi spider that is Jan only... this spider has been hiting this site for 6 months...
I am also listed in Yahoo... like wise I did not pay for inclusion I have gotten 100 hits for Yahoo this month...
I dont know what all the fuss is about...
I personally like the second and third tier SE
they provide me with more traffic then all the other SE combined except Google...
I havent done anything special except write pages that have good content...
And, that's the bottom line because it's my2cents!
By beggers in forum Cusimano.com ScriptsReplies: 7Last Post: September 19th, 2006, 12:17 PM
By hellojello134 in forum Midnight Cafe'Replies: 1Last Post: July 13th, 2005, 06:48 PM
By dollardaze in forum Cusimano.com ScriptsReplies: 2Last Post: November 18th, 2004, 07:07 AM
By eggerda in forum Search Engine OptimizationReplies: 14Last Post: September 15th, 2003, 01:44 PM