Password-protected sites
Sorry if this is covered somewhere else (couldn't find anything), but with the ability to crawl password-protected sites, is it possible to use Archive-It to crawl an intranet, and if so, is there a way to keep it from being viewed on the Wayback Machine?
Thanks for any insights!
-
Official comment
Yes, we've had partners successfully crawl their intranet before. It will take some testing and the success may depend on the specifics of your system. You'll want to use a seed that is behind the log in page and enter your credentials in the seed's settings.
To ensure that all the data captured is inaccessible in any way to the public, please run these crawls in a private collection.Comment actions
Please sign in to leave a comment.
Comments
1 comment