What is data-deduplication and how does it work?

Archive-It has a feature called 'data de-duplication'. If a page has not changed in any way since the last time it was archived for a seed in your collection, the crawler will not store a duplicate copy of that file. This means that unchanged documents will not count toward your Archive-It account's data budget.

Learn more about data de-duplication: About data de-duplication