Results 1 to 4 of 4
  1. #1
    Grandma broke her coccyx! Uncle Rico's Avatar
    Join Date
    May 8th, 2007
    North Carolina
    Several Non-Existant Pages Crawled by Yahoo
    I was checking my custom 404 page log and noticed a bunch of pages that the yahoo crawler was trying to get to, at least I think it's a yahoo spider. I have never had any pages with names like these on my site so I wonder how this happens.

    IP Address:

    Here are a few of the pages the spider was trying to load to but could not...


  2. #2
    general fuq mrbshouse's Avatar
    Join Date
    January 17th, 2005
    it's just them testing to see how your site handles 404s

  3. #3
    ABW Ambassador VampireSkunk's Avatar
    Join Date
    May 24th, 2007
    South East Asia
    They might be testing to see if your site creates pages dynamically (you know, using php to produce pages on the fly using mod rewrite to produce natural-looking paths and .htm extensions)

  4. #4
    Join Date
    December 7th, 2008
    Care to share what will happen then after this "crawling" event? Will it raise the page rank or what? Just curious...

  5. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Site pages not cached in yahoo
    By prince55l in forum Midnight Cafe'
    Replies: 1
    Last Post: July 5th, 2007, 06:08 PM
  2. Would You Put A Yahoo Live Link Badge On Your Pages?
    By Trust in forum Search Engine Optimization
    Replies: 6
    Last Post: January 30th, 2007, 05:11 PM
  3. Yahoo likes my 'Googlized' pages best
    By frank3iii in forum Search Engine Optimization
    Replies: 8
    Last Post: April 26th, 2004, 03:43 AM
  4. Google only crawled 2 pages!?
    By Cyberfire in forum Search Engine Optimization
    Replies: 5
    Last Post: June 2nd, 2003, 12:13 PM
  5. Yahoo Geocities - Pages That Pay
    By marcelle in forum Other Affiliate Networks
    Replies: 0
    Last Post: May 2nd, 2002, 03:45 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts