Katie Fearer
- Total activity 6
- Last activity
- Member since
- Following 0 users
- Followed by 0 users
- Votes 0
- Subscriptions 2
Activity overview
Latest activity by Katie Fearer-
Katie Fearer commented,
Thanks to you both! I just checked and the crawl is actually running much faster now, and I do not see the drawl delay in the robots.text file, so I think all is well. Because this is the first t...
-
Katie Fearer created a post,
Scope rules and speed of crawl - is there and inverse relationship?
One of the state agencies we regularly crawl has set up distinct websites, with distinct domains, for individual projects - nearly 30 of them. We have the option of either establishing new seeds f...
-
Katie Fearer commented,
Command line scripts is an option for us, and the "new data" by seed from each crawl would be a useful statistic. I think this script would help us tremendously if you are willing to share. Thank...
-
Katie Fearer commented,
I am interested in this functionality too, if it exists.