Increasing Open File and Process Settings on Linux Systems

Increasing the number of open files and processes in Watson Explorer Engine may improve performance and reduce error messages.

The maximum user processes (nproc) limit on Linux counts the number of threads within all processes that can exist for a given user. The default value of nproc is 1024 on some versions of Linux, which is generally an insufficient number of threads for all processes. When nproc is too low, you may see Watson Explorer error messages such as "resource temporarily unavailable" or "error creating thread". On systems where Watson Explorer Engine is installed, it is recommended that you set the nproc value to at least 20000.

The maximum open files (nofile) limit has a default value of 1024 on some versions of Linux. On systems where Watson Explorer Engine is installed, it is recommended that you increase the nofile value to 5000.

Both values can usually be modified by editing /etc/security/limits.conf or a file in /etc/security/limits.d/. See your operating system's manual page on limits.conf for more details on modifying these settings.