[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: internet archive (WAS: The Economist and e-Archiving)

To: liblicense-l@lists.yale.edu
Subject: RE: internet archive (WAS: The Economist and e-Archiving)
From: "Janet Smith " <elo575@lycos.co.uk>
Date: Thu, 26 Jun 2003 18:43:50 EDT
Reply-to: liblicense-l@lists.yale.edu
Sender: owner-liblicense-l@lists.yale.edu

Just joined to say that the Wayback Machine is doing a good job at obeying
robots.txt. One of my sites has been archived for more than 3 years. I
wanted them to stop it and excluded ia_archiver. All files have been
removed from their servers within a pretty short period of time. All it
says is:

We're sorry, access to <URL snipped> has been blocked by the site owner
via robots.txt.

Janet Smith
http://www.zomilla.org

Prev by Date: NYTimes.com Article: Measure Calls for Wider Access to FederallyFinanced Research
Next by Date: Sabo Bill: Measure Calls for Wider Access to Federally FinancedResearch
Previous by thread: internet archive (WAS: The Economist and e-Archiving)
Next by thread: RE: internet archive (WAS: The Economist and e-Archiving)
Index(es):
- Date
- Thread