Results 1 to 7 of 7
  1. #1
    Analytics Dude Kevin's Avatar
    Join Date
    January 18th, 2005
    Location
    Rochester, NY
    Posts
    5,904
    Google, Inktomi, and MSN
    Take a look a my bot log files here... Why do you suppose MSN is doing so much better at traversing my site? The robots file shouldn't hinder any of them, and I don't have a robot header... It is a brand new site...

    Tld Country/Domain Bot name Pages Time
    com Commercial msnbot 5 2006-01-06 21:33:57
    com Commercial msnbot 13 2006-01-06 20:30:56
    com Commercial msnbot 3 2006-01-06 19:26:43
    com Commercial msnbot 7 2006-01-06 18:53:58
    com Commercial Inktomi Slurp 1 2006-01-06 18:29:49
    com Commercial msnbot 4 2006-01-06 18:19:44
    com Commercial msnbot 32 2006-01-06 17:56:09
    com Commercial msnbot 13 2006-01-06 16:15:39
    com Commercial Inktomi Slurp 1 2006-01-06 14:57:49
    com Commercial Inktomi Slurp 1 2006-01-06 13:49:17
    com Commercial msnbot 45 2006-01-06 11:04:51
    com Commercial msnbot 1 2006-01-06 09:36:27
    com Commercial Googlebot (Google) 1 2006-01-06 06:15:19
    com Commercial Googlebot (Google) 1 2006-01-06 05:42:03

  2. #2
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    Los Angeles
    Posts
    4,053
    It's not that they're being hindered, they're just not like msnbot. MSN's crawler is very active, crawls constantly and "updates" the index very frequently.

  3. #3
    Analytics Dude Kevin's Avatar
    Join Date
    January 18th, 2005
    Location
    Rochester, NY
    Posts
    5,904
    So no concernes that they aren't crawling? Fair enough. I just don't remember this big of a disparity on my other sites initially.

  4. #4
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    Los Angeles
    Posts
    4,053
    No concerns. And with MSN, a new site can be ranking and pulling traffic in less than a month. How good the traffic is can depend on the niche and demographic, but they are right now the fastest out there.

  5. #5
    ABW Ambassador mailman's Avatar
    Join Date
    January 18th, 2005
    Location
    mailordering.com
    Posts
    906
    Webworker. Would that be why on a given day my site appears on page 1 and then disappears completely?

  6. #6
    Comfortably Numb John Powell's Avatar
    Join Date
    October 17th, 2005
    Location
    Bayou Country, LA
    Posts
    3,432
    Quote Originally Posted by webworker
    but they are right now the fastest out there
    Bill just likes you that's all I have a new site almost a month old and MSN has one page indexed, Google has 499, and Y has 307.

    The same site this month has MSN crawling 5, Y crawled 57, and G gobbled 2195. It could be that I'm doing something that MSN doesn't like, but what?


  7. #7
    Analytics Dude Kevin's Avatar
    Join Date
    January 18th, 2005
    Location
    Rochester, NY
    Posts
    5,904
    By no means is this a scientific statement, and I'm sure one of you has data to prove this "observation" wrong, but:

    The site I wrote about here doesn't have google search or adsense on it.

    I checked my sites that do run those, and have been around *much* longer, and they have less indexed pages in MSN

    Again, I'm sure there's no corelation, but interesting to me
    Kevin Webster
    twitter: levelanalytics

    Kayak Fishing
    Web Analytics and Affiliate Marketing

  8. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Inktomi and MSN Search -- Question
    By Tracy in forum Search Engine Optimization
    Replies: 2
    Last Post: May 7th, 2003, 08:23 PM
  2. MSN/Inktomi Rant
    By affiliatemakeover in forum Search Engine Optimization
    Replies: 7
    Last Post: January 16th, 2003, 06:22 AM
  3. MSN/Inktomi Update
    By Trust in forum Search Engine Optimization
    Replies: 1
    Last Post: January 10th, 2003, 12:59 PM
  4. Inktomi/AOL/MSN - What does it take?
    By snoopy in forum Midnight Cafe'
    Replies: 3
    Last Post: July 8th, 2002, 04:49 PM
  5. Inktomi/AOL/MSN - What does it take?
    By snoopy in forum Search Engine Optimization
    Replies: 3
    Last Post: July 8th, 2002, 04:49 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •