I run a backup script called /root/backup.sh which runs rsync command. However, rsync makes a lot of disks I/O and network I/O. I would like to reduce both disk and network I/O. My server has 10Mbps server connection with 160GB SATA hard drive. How do I reduce disk I/O so that the entire system does not die or become unresponsive?
This is a well-known issue. There are two methods to control or throttle the disk and network I/O rate under UNIX / Linux while using the rsync command.
Adblock detected 😱
My website is made possible by displaying online advertisements to my visitors. I get it! Ads are annoying but they help keep this website running. It is hard to keep the site running and producing new content when so many people block ads. Please consider donating money to the nixCraft via PayPal/Bitcoin, or become a supporter using Patreon.
How To Keep rsync From Using All Your Bandwidth on Linux/Unix/BSD Server
Method # 1: Limit I/O bandwidth using rsync command
The --bwlimit option limit I/O bandwidth. You need to set bandwidth using KBytes per second. For example, limit I/O banwidth to 10000KB/s (9.7MB/s), enter: # rsync --delete --numeric-ids --relative --delete-excluded --bwlimit=10000 /path/to/source /path/to/dest/ OR # rsync -av --delete --numeric-ids --relative --delete-excluded \ --bwlimit=10000 \ /var/www/html vivek@server1.cyberciti.biz:/backups
Method # 2: Take control of I/O bandwidth using ionice utility
The ionice command sets the io scheduling class and priority for a program or script. You can totally control disk i/o. See the following article for detailed examples:
The author is the creator of nixCraft and a seasoned sysadmin, DevOps engineer, and a trainer for the Linux operating system/Unix shell scripting. Get the latest tutorials on SysAdmin, Linux/Unix and open source topics via RSS/XML feed or weekly email newsletter.
7 comment
Thanks
Check your grammar…. ionice command provide more control as compare to nice command.
should read:
The ‘ionice’ command provide more control as compare to the ‘nice’ command
r3dk1ng
redking… it’s as “compared to” not “as compare” to… check your grammar too if you wanna complain :)
@anon, if you’re going to use quotes to illustrate the difference between original and corrective syntax, then you should use the quotes around the same group of words. Let me fix your poor correction to redking.
Should be “as compared to”, not “as compare to”
But then again, redking also missed pluralizing of provides.
Here is the final corrected sentence that both of you screwed up:
The ionice command provides more control as compared to the nice command.
You are welcome.
Guys!!!! Please shut up and fix your own garden any time.
Hilarious ! English as she is spoke.
Thank you server load due to rsync was driving me mad
7 comment
Thanks
Check your grammar…. ionice command provide more control as compare to nice command.
should read:
The ‘ionice’ command provide more control as compare to the ‘nice’ command
r3dk1ng
redking… it’s as “compared to” not “as compare” to… check your grammar too if you wanna complain :)
@anon, if you’re going to use quotes to illustrate the difference between original and corrective syntax, then you should use the quotes around the same group of words. Let me fix your poor correction to redking.
Should be “as compared to”, not “as compare to”
But then again, redking also missed pluralizing of provides.
Here is the final corrected sentence that both of you screwed up:
The ionice command provides more control as compared to the nice command.
You are welcome.
Guys!!!!
Please shut up and fix your own garden any time.
Hilarious ! English as she is spoke.
Thank you
server load due to rsync was driving me mad