Archive-It User Guide
Getting Started
Collections
- Overview of the Collections section
- Create a collection
- Select "seeds"
- Add, edit, and manage your metadata
- Add and edit metadata at the document level
- Upload and download metadata
Scoping
- How our crawler determines scope
- Modify your collection's crawl scope
- Assign and edit a "seed type"
- Seed level scoping vs collection level scoping: What's the difference?
- Identify and avoid crawler traps
- Limit your crawl
Scoping crawls for specific types of sites
- Archiving Internet Archive (archive.org) audio and video
- Archiving Blogspot Sites
- Archiving Wix sites
- Archiving social media sites
- Archiving Facebook pages
- Archiving Flickr streams
Crawling
- Schedule crawls
- Manually start Test and One-Time crawls
- Run, monitor, and save a test crawl
- Resume a finished crawl
- Data de-duplication
- Monitor crawls
Reviewing
- Review your captures
- Reading your crawl report
- Read your crawl's seeds report
- Read your crawl hosts report
- Read your crawl's file types report
- Interpret crawl status codes
Quality Assurance (QA)
Access
- Access Archive-It's Wayback index with the CDX/C API
- Controling the public visibility of specific metadata fields
- Access web archives with the OAI-PMH metadata feed
- Controlling access to your web archives
- Access to your archives in the Archive-It web application
- Browse and Search on Archive-it.org
Storage and preservation
- Partner Guide to Downloading Archive-It Data
- Archive-It Storage and Preservation Policy
- Manually download Archive-It data with a web browser
- Using wget and md5sum to download and verify Archive-It data
- Using the DownloadThemAll! Firefox Web Browser Plugin and md5sum
- Using DownloadThemAll! to download documents
Resources
- Archive-It Crawling Technology
- Archive-It workflow
- Web Archiving Lifecycle White Paper
- Live Archive-It Training Sessions and Webinars
- Archive-It Trial Basics
- Using the Help Center