nixCraft Poll

Topics

Linux File System Limitations For High Performance Computing

Posted by Vivek Gite [Last updated: May 11, 2008]

Linux file systems have a number of limitations that make them a poor choice for large and high-performance computing environments. This article explains some of the pros and cons of Linux and old UNIX file systems:

I am frequently asked by potential customers with high I/O requirements if they can use Linux instead of AIX or Solaris.

No one ever asks me about high-performance I/O -- high IOPS (define) or high streaming I/O -- on Windows or NTFS because it isn't possible. Windows and the NTFS file system, which hasn't changed much since it was released almost 10 years ago, can't scale given its current structure. The NTFS file system layout, allocation methodology and structure do not allow it to efficiently support multi-terabyte file systems, much less file systems in the petabyte range, and that's no surprise since it's not Microsoft's target market.

=> Linux File Systems: You Get What You Pay For

What do you think?

Want to stay up to date with the latest Linux tips, news and announcements? Subscribe to our free e-mail newsletter or RSS feed to get all updates. You can Email this page to a friend.

You may also be interested in other helpful articles:

Discussion on This Article:

  1. G Says:

    My company does a vod server based on IBM or HP 2U servers.

    We use SAS disks with our software raid5 or raid 6. The filesystem we use is XFS.
    We use a slightly modified kernel (lock memory that other processes can’t touch, realtime priorities, etc …)
    We get 18Gb/s of thruput with almost no fluctuation, so we are able to serve 10 000 Mpeg4 streams from one server for several month.

    Linux is perfect for us, and we are a high-end storage user!

    I believe NetApp also runs Linux inside their appliances…

Leave a Reply

We encourage your comments, and suggestions. But please stay on topic, be polite, and avoid spam. Thank you very much for stopping by our site!

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

*
To prove you're a person (not a spam script), type the security word shown in the picture. Click on the picture to hear an audio file of the word.
Click to hear an audio file of the anti-spam word

Tags: , , , , , , , , , , , ,

Copyright © 2004-2008 nixCraft. All rights reserved - TOS/Disclaimer - Privacy policy - Sitemap - Powered by Open source software.