Results 1 to 13 of 13
  1. #1
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    Texas, USA
    Posts
    579
    Lightbulb Burf and Norbert - Instant Indexing Test


    Hi, All,

    re: Burf and Norbert - Instant Indexing Test

    Posted by Burf.com at:

    http://www.webproworld.com/viewtopic.php?t=46603

    Could you please submit your site to Burf.com

    Currently the page you submit should have its meta, url and title indexed. This does need improvement but does work

    Your site should get a visit from Norbert the Spider who is my robot. It then records other urls which come of the page thats submited and stores them

    Alot of work is happening / will be happening on Burf.com as I would like it to be known as a SE

    Currently i seem to be getting 16-20,000 submits a day and it seems alot of people submit thier url many times.

    Let me know what you thing (not site review but se test)
    _________________
    Visit www.Burf.com the new search engine that gives you free keywords and web space

    Visit Burf.com popular forum at www.burfforum.co.uk
    Live by Google, Die by Google.

    More competition for the link-crazed Google can only help in the long run.

    What do you say about submitting some URLs for Burf and Norbert to work with?

    Best,
    RadarCat, WebMaster
    http://www.os2warplinks.com

  2. #2
    Newbie
    Join Date
    October 4th, 2005
    Posts
    34
    Thanks for posting this (made me find the site)

    Well Norbert will be scanning alot more soon as the whole engine is being rewritten and i have a lot of plan for 3 similar engines (UK, Organisations and World)

    Well if you want any more info, let me know!

  3. #3
    Newbie
    Join Date
    October 4th, 2005
    Posts
    34
    New engine is online and recieving 60,000 urls submissions a day

    Thanks Simon
    http://www.burf.com

  4. #4
    Newbie
    Join Date
    October 4th, 2005
    Posts
    34
    Urls seemt to be down, anyone got anysites that they want to submit?

  5. #5
    ABW Ambassador buy_online's Avatar
    Join Date
    January 18th, 2005
    Location
    Richmond, VA
    Posts
    3,234
    I threw a few in for you.

    Fred

  6. #6
    Newbie
    Join Date
    October 4th, 2005
    Posts
    34
    Thanks, currently we are indexing only 3.5 million pages. I hope to increase this to 10 millions which I feel is enough for a small engine.

  7. #7
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    Los Angeles
    Posts
    4,053
    How come the search results are on a subdomain of another domain, with links to two other small UK-based engines/directories at the bottom of the pages?

    Is there a crawler that fetches pages?

  8. #8
    Newbie
    Join Date
    October 4th, 2005
    Posts
    34
    Basically the results server is based at work and so I have used a dynamic ip host which i have not got round to changing as it is not required. The links to the other 2 search engines are 2 that i fould that are interested in doing the same (like yahoo used to list other search engines at the bottom of their results page)

    When I find other SE who are willing to be a results page link then they will be added.

    I was thinking of adding google to the bottom, do you think that would be a good idea?

  9. #9
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    Los Angeles
    Posts
    4,053
    How about a crawler (and User Agent name)?

  10. #10
    Newbie
    Join Date
    October 4th, 2005
    Posts
    34
    User agent is Norbert the Spider(burf.com)

  11. #11
    Resident Genius and Staunch Capitalist Leader's Avatar
    Join Date
    January 18th, 2005
    Location
    Florida
    Posts
    12,817
    Quote Originally Posted by Burf
    User agent is Norbert the Spider(burp.com)
    So are you Burf or Burp? Or both?
    There is no knowledge that is not power. ~Hemingway

  12. #12
    ABW Founder Haiko de Poel, Jr.'s Avatar
    Join Date
    January 18th, 2005
    Location
    New York
    Posts
    21,609
    BURF not burp, burf got spammy so I had to replacement variable the url.
    Continued Success,

    Haiko
    The secret of success is constancy of purpose ~ Disraeli

  13. #13
    Newbie
    Join Date
    October 4th, 2005
    Posts
    34
    I did one shameless link (put it on brakets as a shamless link for a jokey thing) I am offended that you called that spam. Sorry admin, but i really think your over doing this a little.

    Got if a spam bot hit your site (which i am sure have before) is that classed as the 3rd world war?

    Probably best for you if you delete all my posts and then my user account. I cant post on a forum which i was very interested in, when the admin declares i am a spammer to everyone.

  14. Newsletter Signup

Closed Thread

Similar Threads

  1. New Google Indexing
    By jeronimo in forum Midnight Cafe'
    Replies: 12
    Last Post: October 10th, 2010, 07:08 PM
  2. Burf.com free link exchange
    By Burf in forum Midnight Cafe'
    Replies: 4
    Last Post: January 12th, 2006, 04:43 PM
  3. Hi i am burf
    By Burf in forum Introduce Yourself
    Replies: 28
    Last Post: January 12th, 2006, 11:04 AM
  4. Google Indexing
    By joebaracco in forum Search Engine Optimization
    Replies: 2
    Last Post: December 22nd, 2002, 11:48 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •