Customizable Crawl Schedules are now live!
With Archive-It's new Crawl Schedules, you can run multiple recurring crawls at the same frequency within a single collection, giving you more flexibility and control over how your crawls are organized and run.
You can create multiple schedules, each with its own name, frequency, crawl limits, and crawling technology, and assign any number of seeds to the schedule that best fits your needs.
No action is required. Your existing scheduled crawls have been automatically migrated to the new format and will continue running as before.
Crawl Schedules can be viewed, added, and edited from the Overview and Scheduled Crawls pages in each collection. Please see our help center article for instructions on setting up, editing, and managing crawl schedules in your collections.
Don't hesitate to get in touch if you have any questions.
-
Official comment
In case you missed the training on July 22, 2026, you can watch the recording anytime: https://archive.org/details/using-crawl-schedules-training_202608
Comment actions
Please sign in to leave a comment.
Comments
1 comment