Comments on: Linux wget: Your Ultimate Command Line Downloader

By: mohit

mohit — Sun, 18 Dec 2011 18:24:09 +0000

how can i download a file over a https website using wget .

By: gbviswanadh

gbviswanadh — Sun, 18 Sep 2011 11:46:55 +0000

how can extract file are in the format of 111.zip.bz2 and abc.zip.bz2 , so is this possible to bzip2 and unzip a these files in at time command,

By: Ajay

Ajay — Mon, 04 Jul 2011 13:46:21 +0000

You can write a small shell script such that for 5 different files u write 5 wget command inside the shell script and finally run the shell script.

By: Krishna

Krishna — Mon, 04 Jul 2011 12:13:25 +0000

When I use wget to download 5 files from server using a script it sends 1 GET request and waits for server to respond then sends the 2nd and so on. I want the GET to be sent simultaneously irrespective of the response from the server at the same moment. How to do this? Any insights? Thanks

By: Bipin

Bipin — Fri, 20 May 2011 20:23:27 +0000

any Idea to put password from prompt with wget command.

Thanks,
Bipin Bahuguna

By: Ajay

Ajay — Tue, 03 May 2011 10:09:59 +0000

Hello,

how can i use the wget command if the following situation arises

1) when connected to a particular server the wget command will download the file. for this if we set a crontab then at the mentioned time the download will happen. but at time if there is a problem with the server and is not getting connected the wget command will overwrite the existing file with a dummy file there by loosing the contents
Is there any way to prevent this?? i.e. when not connected to the server the wget command should not create or overwrite.

By: m3nt4t

m3nt4t — Sun, 17 Apr 2011 11:34:24 +0000

The easiest way to avoid changing owner/group of download files via wget is to use sudo (run process as other user) or set the download path to a mount point with specific uid/gid (e.g. uid=henry,gid=henry)

By: Dinesh Jadhav

Dinesh Jadhav — Tue, 15 Feb 2011 07:59:57 +0000

I want to change the owner of the file with the wget command, what ever the filles wiil be downloaded needed to change the owner.

By: zack

zack — Wed, 09 Feb 2011 04:40:57 +0000

wget --http-user=***** --http-passwd=********** -O test.txt -o LogFile.txt http://ds.data.jma.go.jp/gmd/ship/data/ShipData/dd/Z__C_RJTD_yyyymmddhhnn--_SHIP_ORIGINAL_AN.txt

Please help me. I want to download data from this website – http://ds.data.jma.go.jp/gmd/ship/download/howtoget.html using above wget command. The problem is how to download the whole one day data with minutes and hour is changing such as starting from 0000UTC-8am(Malaysia local time) 1/1/2010 until 1/1/2010-2350UTC. The data is available for every 10 minutes and time is in UTC format(hhmm).

variable
yyyy=year, mm=month, dd=day, hh=hour, nn=minute

so for this example, yyyy=2010, mm=01, dd=01, hh=hour, nn=minute, user=mmd, passwd=bmlofeb2011

I hope anyone can help me how to download the data.

By: Priya

Priya — Fri, 07 Jan 2011 10:51:48 +0000

Sir,
I have used the command given as example but error is comming as given below.
wget http://www.cyberciti.biz/here/lsst.tar.gz
–21:55:38– http://www.cyberciti.biz/here/lsst.tar.gz
Resolving http://www.cyberciti.biz... 75.126.153.206, 2607:f0d0:1002:51::4
Connecting to http://www.cyberciti.biz|75.126.153.206|:80… failed: Network is unreachable.
Connecting to http://www.cyberciti.biz|2607:f0d0:1002:51::4|:80… failed: Network is unreachable.

By: James Locke

James Locke — Mon, 13 Dec 2010 14:59:11 +0000

I am trying to download data from my server using wget.

I send the login details and store the cookie. I then rotate through n numbers to copy the data into a new file. The saved file is always blank i.e 0kb file size.

My website stores data on individual pages e.g.: (i have changed my actual site name to “mywebsite”)

‘http://admin.mywebsite.com/index.php/print_view/?html=true&order_id=50

I am trying to rotate through the numbers 50 to 1 and extract the data from each page.

The code I am using is below:

#!/usr/bin/perl

system (“wget –post-data ‘username=Test&password=Test&autologin=1′ –cookies=on –keep-session-cookies –save-cookies=cookie.txt http://admin.mywebsite.com/index.php/login“);

$x = 50;
while ($x <= 1) {
system ("wget –wait=400 –post-data 'html=true&order_id=50' –referer=http://admin.mywebsite.com/ –cookies=on –load-cookies=cookie.txt –keep-session-cookies –save-cookies=cookie.txt http://admin.mywebsite.com/index.php/print_view/");

system ("wget –post-data 'html=true&order_id=50' –referer=http://admin.mywebsite.com/ –cookies=on –load-cookies=cookie.txt –keep-session-cookies –save-cookies=cookie.txt http://admin.mywebsite.com/index.php/print_view?");
$x++;
}

How do I modify the code above so data is pulled correctly and the saved files are not blank? Thank you

By: Trav

Trav — Tue, 14 Sep 2010 09:35:45 +0000

Try MultiGet, it also splits the file up into threads to download faster.

By: johnwerhun

johnwerhun — Fri, 27 Aug 2010 18:13:42 +0000

How can I use wget to download Samba in Linux. I’ve tried several times but have been unsuccessful?

By: bayyou

bayyou — Fri, 13 Aug 2010 05:14:57 +0000

$wget -cb -o
********** (10stars)

By: Mark

Mark — Fri, 14 May 2010 03:37:10 +0000

Thanks! $ wget -c -i was very helpful. :)

By: zazuge

zazuge — Sun, 07 Mar 2010 12:41:54 +0000

multi mirror download of a single file trick
wget -c “url1″ -O image.iso
then use dd to fill zeros to the other chunks
dd if=/dev/zero of=image2.iso bs=1024 count=100000
dd if=/dev/zero of=image3.iso bs=1024 count=200000
dd if=/dev/zero of=image4.iso bs=1024 count=300000
…
then on multiple terminals do
wget -c “url2″ -O image2.iso
wget -c “url3″ -O image3.iso

now merge
dd if=image2.iso of=image.iso bs=1024 count=100000 skip=100000
dd if=image3.iso of=image.iso bs=1024 count=100000 skip=200000
…
^^

By: Feseha

Feseha — Sat, 13 Feb 2010 03:50:12 +0000

Quite informative and great time saver!!!
Thanks

By: Palash

Palash — Thu, 15 Oct 2009 08:28:55 +0000

Many many thanks for give important tips of wget.

By: vivian

vivian — Fri, 18 Sep 2009 04:46:26 +0000

Hello, i am not able to use wget in my ubuntu system.. whenever i try to download anything for example,
sudo wget http://www.cyberciti.biz/here/lsst.tar.gz
what i get is
–2009-09-18 10:15:15– http://www.cyberciti.biz/here/lsst.tar.gz
Resolving http://www.cyberciti.biz... 74.86.48.99
Connecting to http://www.cyberciti.biz|74.86.48.99|:80… ^C
The above is same for any website.
i am able to do sudo apt-get install and this is the evidence that i am connecting to the internet. But for wget case i am not able to. Is there any config settings that i need to do?

By: Neela.V

Neela.V — Tue, 15 Sep 2009 06:31:23 +0000

Hi, i need to retrieve a file from an http site, which asks for username and password to access the site. How can i retrieve the file using wget? please guide me.