Rsync Show Progress Bar While Copying Files

Author: Last updated: January 14, 2018 9 comments
I am a new Unix user. I am using rsync to upload and download a large size files. Is there a way to display the progress bar for file? How do I show progress while copying files using rsync locally or remotely on Linux or Unix like operating systems?

rsync is free and open source tool. It is useful to copy local or remote file. It reduces the amount of data sent over the network by sending only the differences between the source files and the existing files in the destination. You can use any one of the following options to add a total progress indicator when copying files from serverA to serverB or vice versa.
Tutorial details
DifficultyEasy (rss)
Root privilegesNo
RequirementsNone
Time5m

ADVERTISEMENTS

  1. rsync command to with --progress option.
  2. pv command – monitor the progress of data or data transfer through a pipe. This is a recommend option for most users.

rsync command to show progress bar

You need to use the --progress or -P option which show progress during file transfer. The syntax is as follows:

rsync --progress source dest
rsync -P source dest
rsync [options] --progress source dest
rsync -av --progress /path/to/*.mp3 /nfs
rsync -av --progress /path/to/*.avi -e user@remote.example.com:/data
###############################################################
## The following only works with the latest version of rsync ##
###############################################################
rsync -av --info=progress2 source dest
rsync -av --info=progress2 /path/to/*.avi -e user@remote.example.com:/data
 
## See the pv command below for more info & syntax ##

Examples

To copy file from /foo/*.tar.gz to a remote server called server1.cyberciti.biz, enter:

rsync -av -P /foo/*.tar.gz nixcraft@server1.cyberciti.biz:~

OR

rsync -av --progress /foo/*.tar.gz nixcraft@server1.cyberciti.biz:~

In this example, copy files from a remote server:

rsync -av --progress root@nas01:/tmp/*Office* .

Sample outputs:

receiving file list ... 
2 files to consider
MacOffice2011wSP2_English.dmg
  1036923510 100%   14.72MB/s    0:01:07 (xfer#1, to-check=1/2)
Office Mac Home and Student 2011 - 1PC-1User Keys.html
        2230 100%   23.67kB/s    0:00:00 (xfer#2, to-check=0/2)
 
sent 64 bytes  received 1037052576 bytes  15363742.81 bytes/sec
total size is 1036925740  speedup is 1.00

The --info=progress2 option shows statistics based on the whole transfer, rather than individual files. Use this flag without outputting a filename (e.g. avoid -v or specify –info=name0 if you want to see how the transfer is doing without scrolling the screen with a lot of names.

rsync -av --info=progress2 root@nas01:/tmp/*Office* .

Sample outputs:

sending incremental file list
MacOffice2011wSP2_English.dmg
  1,036,923,510  99%   39.90MB/s    0:00:24 (xfr#1, to-chk=0/2)
 
sent 1,037,176,846 bytes  received 35 bytes  40,673,603.18 bytes/sec
total size is 1,036,925,740  speedup is 1.00

In this example copy from local computer to remote server:
$ rsync -v --progress debian-9-openstack-amd64.qcow2 vivek@centos7:~/virt/
How to rsync show progress bar Linux and Unix command

Use pv command to monitor progress of rsync command

The pv command allows you to see the progress of data through a pipeline. It provides the following info:

  1. Time elapsed
  2. Percentage completed (with progress bar)
  3. Current throughput rate
  4. Total data transferred
  5. ETA

The syntax is:

rsync options source dest | pv -lpes Number-Of-Files

So if you have 42 files in /tmp/software and you would like to copy them to /nas10, enter:

rsync -vrltD --stats --human-readable /tmp/software /nas10 | pv -lep -s 42

OR

rsync -vrltD --stats --human-readable /tmp/software /nas10 | pv -lep -s 42 >/dev/null

Sample outputs:

Animated gif 01: rsync and pv command demo

Animated gif 01: rsync and pv command demo

See also
  • Man pages: rsync(1)
🐧 Get the latest tutorials on SysAdmin, Linux/Unix, Open Source/DevOps topics:
UP NEXT
CategoryList of Unix and Linux commands
File Managementcat
FirewallCentOS 8 • OpenSUSE • RHEL 8 • Ubuntu 16.04 • Ubuntu 18.04 • Ubuntu 20.04
Network Utilitiesdig • host • ip • nmap
OpenVPNCentOS 7 • CentOS 8 • Debian 10 • Debian 8/9 • Ubuntu 18.04 • Ubuntu 20.04
Package Managerapk • apt
Processes Managementbg • chroot • cron • disown • fg • jobs • killall • kill • pidof • pstree • pwdx • time
Searchinggrep • whereis • which
User Informationgroups • id • lastcomm • last • lid/libuser-lid • logname • members • users • whoami • who • w
WireGuard VPNCentOS 8 • Debian 10 • Firewall • Ubuntu 20.04

ADVERTISEMENTS
9 comments… add one
  • Bart van Bragt May 17, 2011 @ 8:09

    Also add -h to show human readable sizes (350M instead of 367071842).

    Reply Link
  • reply Sep 4, 2012 @ 21:35

    um… That’s not a progress bar. That’s progress output.

    Reply Link
    • MattH Oct 16, 2013 @ 2:51

      --progress is what you are looking for. (incase anyone gets this in a google search like i did)

      rsync -zru --update --progress /path/to/source /path/to/dest
      Reply Link
  • Dana Mar 14, 2014 @ 2:05

    Thanks for the informative post.

    If you are running an “update” to a large folder you may not know how many files will be updated in advance, thus making it difficult to supply the file count to PV without doing an rsync –dry-run first. You can capture the “update” file count into a variable like this:

    FCNT=$(rsync -r --dry-run --ignore-existing --stats --human-readable -e ssh username@192.168.1.40:/home/username/Videos/ ./ | grep -E 'Number of files transferred: ([0-9]+)' | grep -o -E '[0-9]+'); let FCNT+=5

    Then you can call rsync and pv with a reference to the file count variable:

    rsync -rav --ignore-existing -e ssh username@192.168.1.40:/home/username/Videos/ ./ | pv -pteabl -s $FCNT >/dev/null

    A few items to note:

    • The file count variable ($FCNT) has an extra five files added. Why is that? The rsync output from your file xfer will have four lines at the end of the files transferred list as a summary; pv will count those four lines as 5 lines. By adding the 5 lines in advance we’ll prevent our progress bar from going over %100 (by much).
    • The pv parameters I used are slightly different. I like pv -pteabl because it gives me a files-sent-count, time-elapsed, and average throughput on the progress bar.
    • Using the pv -l argument converts the -b parameter from bytes sent to a file count, and converts -s from size of bytes sent to number of lines processed.
    • Your second call to rsync (the one that sends the files) needs to have the -v parameter to list one line per file processed otherwise the pv command will stay at 0%. Similarly if you use -vv or -vvv on the rsync call then pv will receive a much larger number of “files” than predicted.
    • Using the rsync -v switch will cause rsync to list folders it is entering as another line, i.e. another file processed from the pv perspective. In short, if you are processing more than one sub folder with your rsync command the file count passed to pv will be slightly inaccurate.
    Reply Link
  • Nilesh Govindrajan Jun 21, 2014 @ 3:00

    –info=progress2 seems to be available only on 3.1.0+
    I was using 3.0.9 and it complained no such option exists

    Reply Link
  • paolo Sep 4, 2014 @ 14:52

    It can be used with tar command too:

    http://stackoverflow.com/questions/238073/how-to-add-a-progress-bar-to-a-shell-script

    Reply Link
  • chris Dec 6, 2014 @ 9:14

    thank you and all the commenters for the different solutions. it works! :-)

    Reply Link
  • Fabrizio Jul 25, 2017 @ 13:11

    Hi,

    very usefull post.

    Is there a way to do it also if i don’t know the number of files to copy/transfer?
    How to do it all with onoe command?

    Thanks

    Reply Link
  • Tsaavik Jul 26, 2020 @ 14:35

    Already start your rsync and want to know what it’s working on?

    lsof -ad3-999 -c rsync

    Reply Link

Leave a Reply

Your email address will not be published.

Use HTML <pre>...</pre>, <code>...</code> and <kbd>...</kbd> for code samples.

Next FAQ:

Previous FAQ: