Search with numerous pages and different urls for each story

Follow

Susan Paterson

May 14, 2020 23:28

Apologies if this is a basic question. I"m trying to use Archive-it to crawl the following website https://www.ubcic.bc.ca/news 

Is there a way to capture the stories without crawling each individual story? There are several pages and when I've tried to crawl them even using Standard + they don't capture.  I've tried to expand the scope to page=3 for example but no success. Each url is different and they don't have /news in the url. Any advice? Many thanks, Susan 

susan.paterson@ubc.ca

0

• 

  Karl-Rainer Blumenthal May 18, 2020 14:45

  Hi Susan,

  You've got the right idea here! The "plus" seed types should do the trick in this case, so I'd be happy to take a closer look into why the intended contents are still missing. Is there a crawl job number or two that you can point me to in order to see this?

  0

  Comment actions Permalink

Please sign in to leave a comment.