Saving data from select seeds in a test crawl

Follow

Jonathan Bloy

February 10, 2020 17:32

I'm a new user to Archive-It.  I ran my first test crawl, which included multiple seeds. I'm not happy with the data collected from one of the seeds (which included things I should have placed out of scope).  The other data is good, so I want to only save the data from the "good" seeds.  Is this possible?  Or, do I have to delete all the data from the test crawl and try again?

 

0

• 

  Karl Blumenthal February 11, 2020 22:34

  Hi Jonathan!

  Sorry, no, it is not yet possible to save test crawl data selectively. You will need to run a new crawl in order to save the "good" without the "bad." I recommend running each seed in its own separate test crawl if there is any doubt and that is manageable for you, but let us know if you run into any roadblocks.

  0

  Comment actions Permalink
• 

  Jonathan Bloy February 12, 2020 17:26

  Thank you Karl.  That's a good suggestion about using separate test crawls for each seed.

  One more question. If I start another test crawl, does the system consider all data found to be "new," or will I have to delete the data in the original test crawl first, so the system doesn't consider that data as already captured?

  0

  Comment actions Permalink
• 

  Karl Blumenthal February 12, 2020 21:11

  Great question! Thanks for raising it. In fact test crawls do not de-duplicate against one another for precisely this reason, so that you do not have to save both of them to get the intended effects of a second try.

  1

  Comment actions Permalink
• 

  Jonathan Bloy February 13, 2020 15:57

  Good to know.  Thanks again for your help.

  0

  Comment actions Permalink

Please sign in to leave a comment.