Results 1 to 9 of 9
  1. #1
    ABW Veteran Student Heyder's Avatar
    Join Date
    January 18th, 2005
    Posts
    5,482
    The bot plague has hit my websites and eating up bandwidth like crazy. Is this thing on steroids or what?

  2. #2
    ABW Ambassador Jane's Avatar
    Join Date
    January 18th, 2005
    Posts
    1,350
    I don't know but make it stop! I did some major changes on a site this weekend. Google picked it up and it's in the index with a Dec 8th date on it. Not expecting an update so soon I had removed all my Christmas words from the title. Then I put them back, but it was too late. Google updated again and has Dec 9th date on my listing.
    Then there is my other site that had minor changes and google didnt even touch it with the last update.
    Just like a man... always getting lost and going in circles. Someone give the bot a map.

  3. #3
    Affiliate Manager AffiliateBuddha's Avatar
    Join Date
    January 18th, 2005
    Posts
    791
    Dunno about the spidering but there is a sure shot mega indexing going on

    I got more than 200 new pages mintdexed as of december 9th!!

    ---
    "Ambition is like love, impatient both of delays and rivals" - The Tathagata

  4. #4
    Member
    Join Date
    January 18th, 2005
    Posts
    87
    You said you have 200 more pages indexed, can I ask how you know this? Is that just the number of pages the bot peeked at, or are you getting that info from Google somehow?

    Greg

  5. #5
    Full Member
    Join Date
    January 18th, 2005
    Posts
    252
    one way of finding out is entering your domain name in the search box of google excluding WWW & .com etc

  6. #6
    Member
    Join Date
    January 18th, 2005
    Posts
    115
    Mega indexing is good news if you are adding lots of new pages! Even adding a few weekly will help.

    Gabe
    www.1lovecards.com

  7. #7
    ABW Ambassador qball0213's Avatar
    Join Date
    January 18th, 2005
    Posts
    2,158
    <BLOCKQUOTE class="ip-ubbcode-quote"><font size="-1">quote:</font><HR>Originally posted by gwhite:
    You said you have 200 more pages indexed, can I ask how you know this? Is that just the number of pages the bot peeked at, or are you getting that info from Google somehow?

    Greg<HR></BLOCKQUOTE>
    Search for "-111111111 site:sitename.com" without the quotes

  8. #8
    ABW Ambassador ShoreMark's Avatar
    Join Date
    January 18th, 2005
    Location
    NJ, USA
    Posts
    912
    <BLOCKQUOTE class="ip-ubbcode-quote"><font size="-1">quote:</font><HR>Originally posted by qballĀ©:
    Search for "-111111111 site:sitename.com" without the quotes<HR></BLOCKQUOTE>

    Does that -111111111 operate similarly to putting in another variable that you know is on each page? (copyright for instance)

  9. #9
    Affiliate Manager AffiliateBuddha's Avatar
    Join Date
    January 18th, 2005
    Posts
    791
    <BLOCKQUOTE class="ip-ubbcode-quote"><font size="-1">quote:</font><HR>

    Does that -111111111 operate similarly to putting in another variable that you know is on each page? (copyright for instance) <HR></BLOCKQUOTE>

    Nope, the -111111111 will list all the pages under that perticular domain name. [img]/infopop/emoticons/icon_smile.gif[/img]

    ---
    "Ambition is like love, impatient both of delays and rivals" - The Tathagata

  10. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Blocking bots from spidering AE.pl
    By beggers in forum Cusimano.com Scripts
    Replies: 7
    Last Post: September 19th, 2006, 12:17 PM
  2. Slow down spidering
    By dollardaze in forum Cusimano.com Scripts
    Replies: 2
    Last Post: November 18th, 2004, 07:07 AM
  3. Google Spidering...
    By eggerda in forum Search Engine Optimization
    Replies: 14
    Last Post: September 15th, 2003, 01:44 PM
  4. Netfirms and Google Spidering - or lack thereof..
    By JadaKiss in forum Search Engine Optimization
    Replies: 1
    Last Post: May 2nd, 2002, 10:53 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •