Results 1 to 3 of 3
  1. #1
    Grandma broke her coccyx! Uncle Rico's Avatar
    Join Date
    May 8th, 2007
    North Carolina
    GSiteCrawler Question
    I have been looking for a decent sitemap generator and it looks GSiteCrawler is the best free choice.

    Now, I just had it crawl one of my sites. When I look at the "URL List" tab it shows all of the URL's it is going to include. The problem is that each URL is listed twice. So instead of 1000 URL's, I have 2000 URL's listed. What the hell.

    Is this some sort of setting?

    Has something to do with the site being dynamic in nature?

    Is there a fix or setting?

  2. #2
    Tax Paying Member
    Join Date
    November 14th, 2005
    Chapel Hill, NC
    I use this tool and have never encountered the problem which you describe. I checked to see if there was a setting to adjust and did not see one and I also did a recrawl of a couple of sites and could not duplicate your problem.......

    If you are useing this tool for the first time, you may try to download and reinstall it

    Otherwise .........I do not have the foggiest idea of how to solve your problem.
    You must climb this mountain. There is no elevator. ---- Don't stick your finger in the liquid nitrogen.
    Carolina China

  3. #3
    Comfortably Numb John Powell's Avatar
    Join Date
    October 17th, 2005
    Bayou Country, LA
    Has something to do with the site being dynamic in nature?
    All my sites are dynamic. Play with the "Statistics" area and see if you can get a clue and then go over your set up and filters. It's got to work.

  4. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. GSiteCrawler Problem: Not Crawling
    By Uncle Rico in forum Midnight Cafe'
    Replies: 21
    Last Post: June 22nd, 2009, 11:51 AM
  2. Pixel Tracking Question.. (Tech Question)
    By CoolAffiliate in forum Midnight Cafe'
    Replies: 1
    Last Post: August 14th, 2006, 12:40 AM
  3. A question?
    By SandraR in forum Virtual Family and Off-Topic
    Replies: 1
    Last Post: March 20th, 2004, 12:09 AM
  4. Replies: 3
    Last Post: April 29th, 2003, 05:31 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts