File Size Limit Exceeded Error Under Linux and Solution

by on May 4, 2006 · 15 comments· LAST UPDATED September 2, 2013

in , ,

I am trying to copy a file called act.dat. I do have enough disk space to copy this file. I am getting an error "file size limit exceeded" under Linux. How do I get rid of this error?

Your system administrator must have imposed limitation on your account for file size creation. You need to use the ulimit command to find out file size limitation. This command provides control over the resources available
Tutorial details
DifficultyEasy (rss)
Root privilegesYes
RequirementsNone
Estimated completion time5m
to processes started by the shell, on systems that allow such control.

Task: Find out the current resources available to your shell / account

Open the Terminal and then type the following command:
ulimit -a
Sample outputs:

core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
max nice                        (-e) 0
file size               (blocks, -f) 5000
pending signals                 (-i) unlimited
max locked memory       (kbytes, -l) unlimited
max memory size         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) unlimited
max rt priority                 (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 2047
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

The above output clearly stat that you can create file size upto 5MB limit. To change this limit or if you do not wish to have a limit you can edit your /etc/security/limits.conf file (login as the root):
# vi /etc/security/limits.conf
Look for your username and fsize parameter. Delete this line or set new parameter. For example consider following entry where I am setting new file size limit to 1 GB:

vivek       hard  fsize  1024000

Save the changes. Log out and log back in for the changes to take effect.

Now, your limit is 1GB file size. If you do not want any limit remove fsize from /etc/security/limits.conf.

See also
TwitterFacebookGoogle+PDF versionFound an error/typo on this page? Help us!

{ 15 comments… read them below or add one }

1 Deepan.R April 28, 2007 at 11:02 am

Hi,

I too facing the File size limit exceeded error under Linux. But as per the above suggested solution, the ulimit is not setted for the user root, in my case. But still Im getting the error while I connect my USB Hard Drive and try to copy files. No file can be copied more than 4.1GB…I need to copy some 23 GB files and I still have the space in USB.

Kindly inform me what can I do….Mean while, I am aslo searching the web for a solution.

Regards,
Deepan.

Reply

2 Chris September 5, 2007 at 5:21 pm

Deepan.R:

This is probably due to the filesystem that your hard drive is formatted to. Each filesystem has a file size limit of its own. Chances are that the hard drive is formatted as FAT32, which has a 4GB max filesize. If you need it to be able to deal with larger files, consider reformatting to ext3(with a limit of between 16GB to 2 TB)) or something else.

Reply

3 Mani September 20, 2007 at 2:41 pm

Hi,
I tried as per your suggestion.The explanation is very good. It worked well for me. Thanks a lot.

Regards,
Manigandan

Reply

4 Purna April 24, 2008 at 3:37 am

try this command.
#dd if=/dev/zero of=/filesize bs=1024 count=xxxx // to create large file.
If this helps you to create expected filesize then filesystem/os does not limits you.

To create this sort of filesize you have to use LFS. becoz bydefault 32bit compilation is able to address at most 2^31 bytes(2GB).
1. open file with O_LARGEFILE flag or’ed with other falgs.
2. compile your code with -D_LARGEFILE_SOURCE -D_LARGEFILE_SOURCE64 -DLARGEOFFSET_BITS=64

Reply

5 Vasant December 15, 2008 at 12:27 pm

suggestion of converting usb hdd to ext3 format is good. but that format will not be detected in windows xp. so how to come out this problem.

Reply

6 Stephen April 9, 2009 at 10:02 pm

I ran into this, where the apparent limit was 16 GB. To cope with lots of little files, i’d gone out of my way to set up the ext3 filesystem with 1 KB blocks. ext3 with 1 KB blocks limits files to 16 GB. Here’s the schedule:

Ubuntu itself does not have file size limits — It depends what file system you are using the standard is ext3. My drive was under 256GB, so i went with 2 KB blocks.

Filesystem File Size Limit Filesystem Size Limit
ext2/ext3 with 1 KiB blocksize 16448 MiB (~ 16 GiB) 2048 GiB (= 2 TiB)
ext2/3 with 2 KiB blocksize 256 GiB 8192 GiB (= 8 TiB)
ext2/3 with 4 KiB blocksize 2048 GiB (= 2 TiB) 8192 GiB (= 8 TiB)
ext2/3 with 8 KiB blocksize (Systems with 8 KiB pages like Alpha only) 65568 GiB (~ 64 TiB) 32768 GiB (= 32 TiB)
ReiserFS 3.5 2 GiB 16384 GiB (= 16 TiB)
ReiserFS 3.6 (as in Linux 2.4) 1 EiB 16384 GiB (= 16 TiB)
XFS 8 EiB 8 EiB
JFS with 512 Bytes blocksize 8 EiB 512 TiB
JFS with 4KiB blocksize 8 EiB 4 PiB
NFSv2 (client side) 2 GiB 8 EiB
NFSv3 (client side) 8 EiB 8 EiB

Reply

7 Sam July 16, 2009 at 5:36 pm

I love this Q & A stream. I had the file size limit problem and was able to quickly try all the tests proposed here. It is quite clearly a problem with the program I was using. (SoX as it happens.)

Thanks for an excellent diagnosis!

Reply

8 IvyAlice July 21, 2009 at 2:47 pm

What I’m supposed to do when i got this message(when i’m root and i try to copy a too large file, I suppose) but an empty /etc/security/limits.conf file ? (not really empty, but just some comments)

Reply

9 Charanjit Singh May 1, 2010 at 6:53 pm

Hi Chris

Thanks I was also facing the same problem I formatted my USB HDD with ext3 fs after it solved my problem Thanks a ton. I have partition my drive into two part one I had formatted with ext3 (space 120 GB) for testing purpose and rest partition I will format with NTFS (with space 190 GB)and will check again whether this problem will solve in NTFS filesystem or not.

Reply

10 sapy June 24, 2011 at 9:29 am

what is the entry for root max file size limit to 10 GB?
Thanks in advance.

Reply

11 jitta April 13, 2012 at 2:21 pm

Hi sir i am configure samba in Linux, sir my problem the Linux server so many clients send and receiving files . sir my problem any user send the data but server limit 1gb, no copy and paste 1GB more…. please tell me my problem.

Reply

12 sanjay August 29, 2012 at 3:00 pm

If you want OS level file max limit. Add this line in the bottom of /etc/sysctl.conf as root

fs.file-max =

Then load the kernel module ; sysctl -p

Reply

13 Oleg June 16, 2013 at 7:17 pm

Had similar issue, after long day, found what is causing it and it was xdebug.
Issue was caused by this value xdebug.auto_trace=On

Reply

14 nicola September 2, 2013 at 9:38 am

thanks Oleg, your tip save me a lot of time…

Reply

15 Mark July 13, 2013 at 3:33 pm

Simply run “ulimit -f unlimited” and it will set file size to unlimited. No need to go through this ordeal.

Reply

Leave a Comment

Tagged as: , , , , ,

Previous Faq:

Next Faq: