New Wix seeds that contain wixsite.com or wix.com in their URLs will have the default scoping rules automatically applied at the seed level when they are added to a collection. To learn more, including how you can add default scoping rules to existing seeds, please visit Sites with automated scoping rules.

It’s possible to crawl, archive, and replay most websites built on the platform Wix. These sites sometimes do not require any crawl scope modification. However, some Wix templates can result in incomplete capture or replay.  Using the recommended scoping rules will increase the likelihood that the website will capture and replay fully, however some Wix sites experience further replay issues.  Please see our prioritization of support tickets for more information.

General scoping rules for Wix

To ensure that all necessary scripts, stylesheets, and embedded media are archived, we recommend modifying the scope of crawls of Wix-based sites to include the following rules:

1. Ignore Robots.txt files on the following hosts:
   • frog.wix.com
   • static.parastorage.com
2. Expand the scope of your crawl to include URLs that contain the following strings of text:
   • frog.wix.com
   • static.parastorage.com
   • static.wixstatic.com
   • sslstatic.wix.com
3. Replay of Sites built on the Wix platform may be improved by adding and crawling sub-pages(e.g. http://www.website.com/subpage) added as private One Page seeds. To do this, add sub-pages as private One Page seeds, add the recommended Wix scoping rules to each seed, and include them in a crawl with the main Wix seed.

Keep in mind when you are reviewing your crawls, you should also navigate through the base domain's Wayback link to QA the sub-pages.

Avoid crawler traps

Some templates used for Wix-based sites generate a significant number of long and ultimately invalid URLs that look like the one below:

http://www.example.com/uU5dR1gpXCHX45K8aOMct11OrLtyrYJeUnw_RxaUsg.eyJpbnN0YW5jZUlkIjoiMTNkZDc1ZTQtY2E2MC00ZGJkLWU4YTUtYTg xZjMxMzIyODVjIiwic2lnbkRhdGUiOiIyMDE1LTA1LTI4VDAwOjI5OjI5LjA3OFoiLCJpcEFuZFBvcnQiOiIyMDcuMjQxLjIyNi4xMTYvNDU2NTEiLCJkZW1vTW9kZSI6ZmFsc2UsImJpVG9rZW4iOiIxZjJjNTNlYS1hMGJjLTAyYmYtNDEwYi04N2E1N2IwNWZmYmMifQ

These URLs are usually unnecessary to replay the site correctly, but can still vastly expand the amount of documents and volume of data archived, which negatively affects your subscription budget. To prevent the crawler from accessing URLs like the one above, modify the scope of your crawl to block URLs that match the following regular expression, exactly as it appears here: ^.*/[^/]{300,}$