No specific scoping rules are necessary for medium.com seeds. However, medium seeds can be data heavy, so we recommend a test crawl to start. This will help to identify places to limit data by using seed-level block rules.
What to expect from your archived Medium seeds:
Some medium seeds have playback issues, where the content was captured, but is not able to fully replay. This is something for which we are working on a long-term development fix. Please review the results of these crawls for completeness and accuracy.
Comments
0 comments
Please sign in to leave a comment.