Archive.is blog: Twitter archival is slow, so limit the number of tweets you save in it
Posted by jpluimers on 2022/03/04
[Wayback] Archive.is blog — The website has been slow for some time when…
The website has been slow for some time when archiving Twitter pages, but works fine with other websites. Is there a reason for that? Thx!
Anonymous
1. There are too many pages from Twitter in the queue, which reduces their priority (if it wasn’t for this condition, it would slow everything down)
2. Twitter API sometimes responds with “429 Too Many Requests” or other error, so it usually takes more than 1 attempt to capture the page.
I would suggest refraining from saving pages from Twitter for now, especially those people trying to save dozens or hundreds of tweets
–jeroen
The Wiert Corner - irregular stream of stuff 
Leave a comment