Hi there - looking for some assistance with a crawl I'm running. I'm pretty new to scoping crawls so appreciate assistance.
My primary URL for crawling is a University HR program website with a url like: www.mit.edu/hr/program/
There are PDF and images linked to the webpages which come from www.mit.edu/groups/hr/
thanks for all replies
Digital Archivist, MIT Institute Archives and Special Collections
Please sign in to leave a comment.