Test Crawl Not showing up in Wayback
I keep on getting this message when I try to view my test crawls in the wayback. It has been over 24 hours.
Not in Archive
The page you requested has not been archived in Archive-It.
This could be for a number of reasons.
Most likely the page you are requesting was outside of the crawler's scope. Try another request or click to see other pages from https:.
It is also possible that this site is currently being crawled and the archived pages are not yet available in the Wayback Machine. It can take up to 24 hours after a crawl has been completed for the site to appear in the Wayback Machine. Please try again after the allotted time.
-
Hi Krista,
Can you confirm for me that you are looking for these test captures on the other end of the "Wayback" links in those crawls' Seeds reports?
And not from the Wayback links in an entire collection's seed list?
The latter will lead you only to captures that were permanently saved to your collection, so it is necessary to find test-crawled contents through their reports unless and until you decide specifically to save them.
If you can't find the captures there, then please do let me know which crawls are misbehaving and I'd be happy to take a closer look.
-
Hi there, I am having the same issue with my test crawls. They are over 24 hours and seem to have captured material, but I get the same "not in archive" message. I am going in through the test crawl seed - wayback link. I can usually get to the date of capture, but when I click on the date I then get the "not in archive" message.
-
Thanks for reporting this, all! I can confirm from here on the back end that test captures are a little slower than usual to index and appear where we would expect them in Wayback. Apologies for the delay, but the crawls are indeed running and storing. We are updating Archive-It's System Status page here to reflect our progress on these, but I'll be sure to check back in with everyone here too when we're all caught up.
-
I am having a similar problem to this with a saved test crawl. It has been 34 hours since the test crawl was saved and I am still getting the same message as in the op. I am also getting the message when trying to go to Wayback in the test crawl report, which had worked prior to saving. The only problem test crawl is a brozzler test crawl, while the Wayback links on several standard test crawls saved around the same time are working properly.
Please sign in to leave a comment.
Comments
9 comments