For my archive somewhere between cURL 7.21.0 and 7.34.0 it does not like to be started from an RDP based tsclient
share:
C:\Users\jeroen\Downloads>\\tsclient\bin\curl.7.21.0.exe --remote-name https://www.xs4all.nl/index.html % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 86465 0 86465 0 0 60805 0 --:--:-- 0:00:01 --:--:-- 70012 C:\Users\jeroen\Downloads>\\tsclient\bin\curl.7.34.0.exe --remote-name https://www.xs4all.nl/index.html % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (6) Could not resolve host: web.archive.org C:\Users\jeroen\Downloads>\\tsclient\bin\curl.7.61.0.exe --remote-name https://www.xs4all.nl/index.html % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (6) Could not resolve host: www.xs4all.nl C:\Users\jeroen\Downloads>copy \\tsclient\bin\curl.7.61.0.exe 1 file(s) copied. C:\Users\jeroen\Downloads>curl.7.61.0.exe --remote-name https://www.xs4all.nl/index.html % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 13 0 13 0 0 10 0 --:--:-- 0:00:01 --:--:-- 10
It fails the same way after net use B: \\tsclient\bin
, so that does not matter.
The best link I could find until I got to the real problem was [WayBack] curl: (6) Could not resolve host: application – Stack Overflow which shows a different problem: properly quoting.
In addition to remote-name
, you can also grab the file name from the headers using --remote-header-name
, and --remote-time
use the remote file time. The --location
follows 302-redirects. You can see that in the example below which I build based on
[WayBack] unix – Curl to grab remote filename after following location – Stack Overflow: The remote side sends the filename using the Content-Disposition header.curl 7.21.2 or newer does this automatically if you specify –remote-header-name / -J.curl -O -J -L $url
C:\Users\jeroen\Downloads>b:\curl.7.21.0.exe --location --remote-name --remote-time --remote-header-name "https://web.archive.org/web/20180712073755if_/https://www.danielwolf.eu/?wpdmdl=1965" % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 86465 0 86465 0 0 45748 0 --:--:-- 0:00:01 --:--:-- 50772 curl: Saved to filename 'pkgWuppdiWP_DX102T_1-1-2.zip'
wget failed big time:
C:\Users\jeroen\Downloads>B:\wget.exe --no-check-certificate -v -v -v --content-disposition --restrict-file-names=windows "https://web.archive.org/web/20180712073755if_/https://www.danielwolf.eu/?wpdmdl=1965" wget: Cannot read b:/.wgetrc (No such file or directory). --2018-07-12 09:55:23-- https://web.archive.org/web/20180712073755if_/https://www.danielwolf.eu/?wpdmdl=1965 Resolving web.archive.org... 207.241.225.186 Connecting to web.archive.org|207.241.225.186|:443... failed: Invalid argument. Retrying. ... --2018-07-12 09:55:23-- (try:20) https://web.archive.org/web/20180712073755if_/https://www.danielwolf.eu/?wpdmdl=1965 Connecting to web.archive.org|207.241.225.186|:443... failed: Invalid argument. Giving up.
This is not caused by the filename (Windows does not like the ?
question mark in output file names, so – like &
ampersand in file URLs – you have to quote the full URL, but also provide the --restrict-file-names=windows
parameter; see [WayBack] wget – I can’t download files with “?” – Super User).
–jeroen