is there a tool to scrape a twitter account's media and deduplicate?
@mavica_again can `yt-dlp` do it? ime it can scrape individual tweets
@bonzoesc i tried wfdownloader but you need to be logged in for twitter accounts now. this is a bot account that posts from a cache of images every hour and i'm trying to archive them. there's a mastodon mirror that hasn't posted since last june i'm trying to scrape instead now
mite b easier to just download from the mastodon version of the bot which has sadly stopped