Archive-It product updates - January 2026

Wayback - We continued to fine-tune rate limiting to Wayback, reducing latency and improving overall performance for users. 

Bug fixes: We resolved an issue where internal staff admin accounts could generate large API requests that slowed overall application performance.

Crawlers - We improved Brozzler’s retry logic to make it more resilient to mid-crawl errors or interruptions. We also made the following version updates: 

• Standard crawls are now running Heritrix version 3.11.1

• Standard and Brozzler are running yt-dlp version 2025.12.08.

Crawl Scheduling - We made more under-the-hood updates to systems that manage scheduled crawling as we continue to build the foundation for the upcoming scheduled crawl enhancement.