Few people realise that in addition to uploading through the Internet Archive web user interface at [Wayback/Archive] Upload to Internet Archive, you can also upload through the command-line.
Fewer people know using the CLI is more reliable, as the web UI often has trouble with recovery from upload interruptions (but it is better than the Wayback Machine archiver which seems to have no recovery options at all).
Jason Scott responded to a really rude comment of an uploader, but the Internet Archive does not really advocate the CLI uploader much. I added a comment, but doubt that has changed: it regrettably is an organisation that has a track record of being quite reluctant to publicly show improvement.
The whole thread is at [Wayback/Archive] Post by @textfiles.com — Bluesky: Regarding large-size uploads, especially over, let’s say, 750mb to the Internet Archive, I highly suggest the ia command-line client, which has a separate pathway not dealing with weird browser oddities and behavior.… and archived for posterity.
TL;DR
- you can batch upload to the base Internet Archive
- you cannot batch upload to the Wayback Machine of the internet archive
First, a list on how you can find the CLI tooling the normal way:
Read the rest of this entry »