Avatar

Skip Kendall

  • Total activity 116
  • Last activity
  • Member since
  • Following 0 users
  • Followed by 0 users
  • Votes 69
  • Subscriptions 26

Activity overview

Latest activity by Skip Kendall
  • Avatar

    Skip Kendall commented,

    We've been exploring all three. I wouldn't call any of them a high priority yet but I can see Threads, especially, getting there.

  • Avatar

    Skip Kendall commented,

    Hi Dan, Instagram's a pain. We haven't been able to directly crawl it for more than a year. Just isn't possible. For a while, we used manual tools (Webrecorder, Conifer) and then uploaded the WARCs...

  • Avatar

    Skip Kendall commented,

    Interesting. It's been working fine for me. The only thing I can think is that, when you're actually crawling the YouTube channel, you need to go to the watch pages in order to view the videos. You...

  • Avatar

    Skip Kendall commented,

    I suspected that was what you were having problems with. That is actually not what Archive-It describes as a repeating directory. A repeating directory would be something like https://www.royalroad...

  • Avatar

    Skip Kendall commented,

    Kate, I don't see any links on that page to repeating directories. What's an example of what you're seeing? Skip

  • Avatar

    Skip Kendall commented,

    Katie, I recently touched on this topic with the help desk and they indicated that it's possible that a lot of scoping could slow down a crawl but they didn't really know for sure. Another thing th...

  • Avatar

    Skip Kendall commented,

    Abigail, They're non-public seeds you run along with a public seed to achieve some desired result. In some cases, the page will only be captured properly if run as a seed. Another use case is with ...

  • Avatar

    Skip Kendall commented,

    Don't know how long you've been waiting but they do usually show up within a day or so. If there are indexing slowdowns, it can certainly take longer but I think the recent issue with that has been...

  • Avatar

    Skip Kendall commented,

    Huh. 'Tis certainly odd. I'd submit a ticket to see if the Archive-It folks can see what's going haywire.

  • Avatar

    Skip Kendall commented,

    Doesn't appear to be a crawling problem as I get the same behavior in my browser. Looks like they automatically redirect to the overview page if you try to land on /latest/. Seems like you should b...