Recently there was some problem with one of the quite old Dell RHEL box. Application was not working. Someone installed some old binary application. At some point application was crashing under Red Hat enterprise Linux 2.1.
After exchanging tons of email with application vendor and RedHat, problem was solved by installing latest version of Red hat enterprise Linux.
open() sys call was a problem….
The problem was the open() sys call in application. The open() system call is used to convert a pathname into a file descriptor (a small, non-negative integer for use in subsequent I/O as with read, write, etc.). When the call is successful, the file descriptor returned will be the lowest file descriptor not currently open for the process. This call creates a new open file, not shared with any other process. But shared open files may arise via the fork() system call. The new file descriptor is set to remain open across exec functions . The file offset is set to the beginning of the file. If you are a developer read man page of open for more info (man 2 open).
This kind of problems is hard to trace and debug :(
Later RedHat tech support told us that direct I/O is supported in only in Red Hat Enterprise Linux version 3 over above. Interestingly application was working fine on old version of Debian Linux.
Bottom line if application is not working just try it on latest version and it may save your a$$.