Updates on that pesky Facebook security check
Many partners have reported a problem crawling and replaying Facebook seeds that manifests as a "Security Check" beyond which the viewer of an archived page cannot browse (see below).
Our engineers have since implemented a solution that restores our crawler's access to the obstructed Facebook content. At the moment, you can expect to see three (3) distinct captures listed on each Facebook seed's Wayback calendar page, only one of which will consistently lead to the properly archived content.
We're working actively to resolve that last piece of the puzzle -- just so that only the "good" captures appear on the calendar moving forward. In the meantime, rest assured that we are still crawling and archiving Facebook content. Let us know, however, if you see this problem manifest at all differently, and we'll take a closer look!
We'll update this thread and our guide to archiving Facebook pages just as soon as we have new information.
Thanks to all for your patience on this one!
-
Hi again, everyone! Just wanted to drop in again this morning to let you know that we have indeed deployed an improvement on our end that we hope will resolve the issue with "bad"/CAPTCHA-blocked Faccebook captures from appearing on the Wayback calendar page. From this point on, your Facebook crawls should result in only the "good" capture links appearing on those calendars. By all means report to us directly if you see anything to the contrary so that we may make any necessary improvements to our fix.
Thanks again to all for your patience as we work through this stickiest of wickets :-)
-
Hi again, all! Checking in briefly this time to let you know that we continue to monitor the quality of Facebook captures and tweak our crawl and replay mechanisms accordingly, however our latest deployments appear to have resolved any remaining issues with the “captcha”-style security block as well as some lingering issues that some partners saw with page scrolling.
You may continue to crawl your Facebook seeds with our recommended scoping adjustments, always available for your reference here (and through the “Help” widget in the web app!): https://support.archive-it.org/hc/en-us/articles/208333113-Archiving-Facebook-pages
Of course these latest recommendations, expectations for replay, and all others like them are made possible by you! As Facebook continues to change codes and styles, we rely on you to let us know if we can address any future issues.
Please sign in to leave a comment.
Comments
3 comments