Results 1 to 4 of 4
  1. #1
    Grandma broke her coccyx! Uncle Rico's Avatar
    Join Date
    May 8th, 2007
    Location
    North Carolina
    Posts
    2,238
    Several Non-Existant Pages Crawled by Yahoo
    I was checking my custom 404 page log and noticed a bunch of pages that the yahoo crawler was trying to get to, at least I think it's a yahoo spider. I have never had any pages with names like these on my site so I wonder how this happens.

    IP Address: 74.6.22.177
    Host: llf520046.crawl.yahoo.net

    Here are a few of the pages the spider was trying to load to but could not...

    /SlurpConfirm404/caminante/president/coverpage.htm
    /SlurpConfirm404/kkataoka/cgk.htm
    /SlurpConfirm404/ripem/alcdrog.htm
    /SlurpConfirm404/tokyov.htm
    /SlurpConfirm404/timeline/commentary/v050a.htm
    /SlurpConfirm404/media_f.htm
    /SlurpConfirm404/wrsrl.htm
    ....

  2. #2
    general fuq mrbshouse's Avatar
    Join Date
    January 18th, 2005
    Location
    Argieville
    Posts
    1,381
    it's just them testing to see how your site handles 404s

  3. #3
    ABW Ambassador VampireSkunk's Avatar
    Join Date
    May 24th, 2007
    Location
    South East Asia
    Posts
    1,045
    They might be testing to see if your site creates pages dynamically (you know, using php to produce pages on the fly using mod rewrite to produce natural-looking paths and .htm extensions)

  4. #4
    Newbie
    Join Date
    December 7th, 2008
    Posts
    16
    Care to share what will happen then after this "crawling" event? Will it raise the page rank or what? Just curious...

  5. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Site pages not cached in yahoo
    By prince55l in forum Midnight Cafe'
    Replies: 1
    Last Post: July 5th, 2007, 07:08 PM
  2. Would You Put A Yahoo Live Link Badge On Your Pages?
    By Trust in forum Search Engine Optimization
    Replies: 6
    Last Post: January 30th, 2007, 06:11 PM
  3. Yahoo likes my 'Googlized' pages best
    By frank3iii in forum Search Engine Optimization
    Replies: 8
    Last Post: April 26th, 2004, 04:43 AM
  4. Google only crawled 2 pages!?
    By Cyberfire in forum Search Engine Optimization
    Replies: 5
    Last Post: June 2nd, 2003, 01:13 PM
  5. Yahoo Geocities - Pages That Pay
    By marcelle in forum Other Affiliate Networks
    Replies: 0
    Last Post: May 2nd, 2002, 04:45 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •