Results 1 to 2 of 2
  1. #1
    ABW Ambassador John Kruger's Avatar
    Join Date
    January 18th, 2005
    Location
    At my computer
    Posts
    645
    Archive.org
    Any thoughts why the archive would stop spidering a site?

    John

  2. #2
    ABW Ambassador DesignerWiz's Avatar
    Join Date
    January 18th, 2005
    Location
    U.S.A
    Posts
    2,777
    Hi John,

    Have you verfied that you have not banned IA_archiver in your ROBOTS.TXT file?

    ia_archiver
    ia_archiver/1.6
    Ray Thomas
    Webmaster Resources: http://DesignerWiz.com
    ABW Board Category: Programming / Coding
    http://forum.abestweb.com/forumdisplay.php?f=190

  3. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Archive.org working?
    By Eric Ewe in forum Midnight Cafe'
    Replies: 2
    Last Post: July 17th, 2008, 04:16 PM
  2. Replies: 0
    Last Post: February 21st, 2008, 10:52 PM
  3. Replies: 2
    Last Post: September 25th, 2007, 07:43 PM
  4. Replies: 5
    Last Post: February 22nd, 2007, 05:17 AM
  5. Replies: 2
    Last Post: September 10th, 2003, 04:35 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •