Avatar

Skip Kendall

Follow
  • Total activity 116
  • Last activity
  • Member since
  • Following 0 users
  • Followed by 0 users
  • Votes 69
  • Subscriptions 26

Activity overview

Latest activity by Skip Kendall
  • Avatar

    Skip Kendall commented,

    1. Community
    2. Announcements
    3. Archiving Bluesky, Threads, and Mastodon

    We've been exploring all three. I wouldn't call any of them a high priority yet but I can see Threads, especially, getting there.

    • View comment
    • Skip Kendall
    • Created
    • 0 votes
  • Avatar

    Skip Kendall commented,

    1. Community
    2. Community Help
    3. Instagram Web Crawling

    Hi Dan, Instagram's a pain. We haven't been able to directly crawl it for more than a year. Just isn't possible. For a while, we used manual tools (Webrecorder, Conifer) and then uploaded the WARCs...

    • View comment
    • Skip Kendall
    • Created
    • 0 votes
  • Avatar

    Skip Kendall commented,

    1. Community
    2. Community Help
    3. YouTube and Embedded Video Capture Issues

    Interesting. It's been working fine for me. The only thing I can think is that, when you're actually crawling the YouTube channel, you need to go to the watch pages in order to view the videos. You...

    • View comment
    • Skip Kendall
    • Created
    • 0 votes
  • Avatar

    Skip Kendall commented,

    1. Community
    2. Community Help
    3. Repeating Directory

    I suspected that was what you were having problems with. That is actually not what Archive-It describes as a repeating directory. A repeating directory would be something like https://www.royalroad...

    • View comment
    • Skip Kendall
    • Created
    • 0 votes
  • Avatar

    Skip Kendall commented,

    1. Community
    2. Community Help
    3. Repeating Directory

    Kate, I don't see any links on that page to repeating directories. What's an example of what you're seeing? Skip

    • View comment
    • Skip Kendall
    • Created
    • 0 votes
  • Avatar

    Skip Kendall commented,

    1. Community
    2. Community Help
    3. Scope rules and speed of crawl - is there and inverse relationship?

    Katie, I recently touched on this topic with the help desk and they indicated that it's possible that a lot of scoping could slow down a crawl but they didn't really know for sure. Another thing th...

    • View comment
    • Skip Kendall
    • Created
    • 0 votes
  • Avatar

    Skip Kendall commented,

    1. Community
    2. Community Help
    3. Helper Seeds

    Abigail, They're non-public seeds you run along with a public seed to achieve some desired result. In some cases, the page will only be captured properly if run as a seed. Another use case is with ...

    • View comment
    • Skip Kendall
    • Created
    • 1 vote
  • Avatar

    Skip Kendall commented,

    1. Community
    2. Community Help
    3. Saved Test Crawl not showing up in Public Collection Link

    Don't know how long you've been waiting but they do usually show up within a day or so. If there are indexing slowdowns, it can certainly take longer but I think the recent issue with that has been...

    • View comment
    • Skip Kendall
    • Created
    • 1 vote
  • Avatar

    Skip Kendall commented,

    1. Community
    2. Community Help
    3. Crawler refuses to collect?

    Huh. 'Tis certainly odd. I'd submit a ticket to see if the Archive-It folks can see what's going haywire.

    • View comment
    • Skip Kendall
    • Created
    • 0 votes
  • Avatar

    Skip Kendall commented,

    1. Community
    2. Community Help
    3. Crawler refuses to collect?

    Doesn't appear to be a crawling problem as I get the same behavior in my browser. Looks like they automatically redirect to the overview page if you try to land on /latest/. Seems like you should b...

    • View comment
    • Skip Kendall
    • Created
    • 0 votes