Results 1 to 17 of 17
  1. #1
    ABW Veteran Student Heyder's Avatar
    Join Date
    January 18th, 2005
    Posts
    5,482
    I've added spidering capabilities to searchany.com. The way it works is my paid listings remain at the top of the index while crawled listings will be placed after them and then third party ppc listings.

    I am able to crawl the entire site and will do so for anyone that places my search box on the submitted site.

    Go to addurl if you want to submit your site.

    Results can be seen by performing a search at www.searchany.com

    This should be to everyones benefit and if you've submitted a page and don't want to place my search box on it but are willing to place it in another location on the same site please PM me with the location and I'll gladly include you.

    [ 03-27-2002: Message edited by: Heyder ]

  2. #2
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    ÄúsTrálíĺ
    Posts
    1,372
    It worked for my sites. Added straight away.

    The relevancy of some search is off though - example, but I think these are the paid feed ones.

    also, some of the listings end in "uM".. couldn't quite figure that one out [img]/infopop/emoticons/icon_smile.gif[/img]

    Also, see results 17-23

    hey.. .dmoz rated higher than me [img]/infopop/emoticons/icon_frown.gif[/img] who woulda thought?

    update: noticed that it spiders.. I thought it was going to add one page, but is ripping through my collectibles page. good going [img]/infopop/emoticons/icon_smile.gif[/img]

  3. #3
    ABW Veteran Student Heyder's Avatar
    Join Date
    January 18th, 2005
    Posts
    5,482
    The unrelated listings are paid bids that are called catchall listings. A fairly good service for someone that just wants traffic.

    The goofy things like "Um" as well as other strange things are shown that way simply because they exist that way.

    Thanks for submitting Pete

  4. #4
    ABW Founder Haiko de Poel, Jr.'s Avatar
    Join Date
    January 18th, 2005
    Location
    New York
    Posts
    21,609
    Heyder,

    PMed you!

    Haiko

  5. #5
    ABW Veteran Student Heyder's Avatar
    Join Date
    January 18th, 2005
    Posts
    5,482
    Pete,

    Just because I'm such a nice guy I will delet dmoz. LOL

    [img]/infopop/emoticons/icon_biggrin.gif[/img]

  6. #6
    ABW Veteran Student Heyder's Avatar
    Join Date
    January 18th, 2005
    Posts
    5,482
    Haiko,

    I think there's something wrong with the PM system. I haven't gotten yours yet and I was having problems earlier this week with it also.

  7. #7
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    ÄúsTrálíĺ
    Posts
    1,372
    lol.
    does it follow all links, or only .html ones? eg, will it follow .php or .php?this=that&that=this ?
    I've seen the fluid dynamics script around before, but never run it on one of my sites.

  8. #8
    ABW Veteran Student Heyder's Avatar
    Join Date
    January 18th, 2005
    Posts
    5,482
    It goes everywhere unless there is a robots txt file and it's very manual so I have to do a lot of the work, which is good for my purpose because I'm looking at not crawling the web so much as building site traffic by requiring links in exchange for spidering.

    It wants all them qsrv links too but I've been removing them.

  9. #9
    ABW Founder Haiko de Poel, Jr.'s Avatar
    Join Date
    January 18th, 2005
    Location
    New York
    Posts
    21,609
    H,

    Was AFK ... it is sent now.

    Haiko

  10. #10
    ABW Veteran Student Heyder's Avatar
    Join Date
    January 18th, 2005
    Posts
    5,482
    Okay now I gots it<IMG src=http://www.abestweb.com/ubb/icons/icon6.gif>

  11. #11
    pph Expert! Gordon's Avatar
    Join Date
    January 18th, 2005
    Location
    Edmonton Canada
    Posts
    5,781
    Hey it sure work fast Heyder, shame I am not #1 though [img]/infopop/emoticons/icon_wink.gif[/img]

  12. #12
    ABW Veteran Student Heyder's Avatar
    Join Date
    January 18th, 2005
    Posts
    5,482
    Pete I guess I'm wrong about that Um thing. I don't know what's causing that.

    Update "uM" problem fixed.


    Gordon, I try [img]/infopop/emoticons/icon_wink.gif[/img]

    [ 03-25-2002: Message edited by: Heyder ]

  13. #13
    Full Member
    Join Date
    January 18th, 2005
    Posts
    236
    HI
    Well it seems to work fine and I am listed at both my sites so am a happy man.

    Now all I want is some traffic. 20 - 30 hits a day at the moment really would like that to 100 plus per day.

    Ah such is life, glad I dont do this for a living.

    regards John

  14. #14
    ABW Veteran Student Heyder's Avatar
    Join Date
    January 18th, 2005
    Posts
    5,482
    I made a change

    To up the traffic coming in to the listings I've now made it so that new submissions are required to place my search box on their page. At first I was leary of doing this but after thinking about it I believe it's a great idea. All the traffic will continue to grow and benefit everyone.

  15. #15
    Assistant Regional Manager Rik's Avatar
    Join Date
    January 18th, 2005
    Location
    New Zealand
    Posts
    865
    Sounds like a fair proposition to me Heyder. It's a really good idea with a win win situation for everybody involved.

    <IMG src=http://www.abestweb.com/ubb/icons/icon14.gif>

  16. #16
    ABW Veteran Student Heyder's Avatar
    Join Date
    January 18th, 2005
    Posts
    5,482
    That is good to hear! Thanks

  17. #17
    Full Member
    Join Date
    January 18th, 2005
    Posts
    352
    Got error when I submitted PHP sites :confused:

  18. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. A little experiment I did
    By HardwareGeek in forum Midnight Cafe'
    Replies: 40
    Last Post: June 9th, 2007, 12:48 PM
  2. Link Experiment
    By Core in forum Midnight Cafe'
    Replies: 7
    Last Post: March 21st, 2007, 01:59 PM
  3. Experiment
    By icicle in forum Midnight Cafe'
    Replies: 0
    Last Post: April 23rd, 2002, 09:44 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •