Network.URL.Archiver
- checkArchive :: String -> String -> IO ()
- webciteArchive :: String -> String -> IO ()
- alexaArchive :: String -> IO ()
Documentation
Error check the URL and then archive it using webciteArchive and alexaArchive
webciteArchive :: String -> String -> IO ()Source
Request http://www.webcitation.org to copy a supplied URL; WebCite does on-demand archiving, unlike Alexa/Internet Archive, and so in practice this is the most useful function. This function throws away any return status from WebCite (which may be changed in the future), so it is suggested that one test with a valid email address.
Warning! WebCite has throttling mechanisms; if you request more than 100 URLs per hour, your IP may be banned! It is suggested that one sleep for ~30 seconds between each URL request.
alexaArchive :: String -> IO ()Source
Request http://www.alexa.com to spider a supplied URL. Alexa supplies the Internet Archive's caches. TODO: currently broken? Alexa changed pages? is down?