Troubleshooting
Problem
Filesystems can have a hard limit on number of subdirectories that can be contained in a directory, for example 32766 (32K -2) for JFS on AIX, EXT3 on Linux and vxfs/hfs on HP-UX. For every job, DataStage will create hash files as subdirectories in the project directory. Here is a list of the subdirectories created for every job. In this list "nn" represents the number (or id) of the job: DS_TEMPnn RT_CONFIGnn RT_STATUSnn RT_LOGnn RT_BPnn RT_BPnn.O RT_SCnn (only for parallel jobs) As the number of subdirectories in a directory is limited to 32766, the maximum number of jobs for a project will be, in theory, approximately 4600 parallel jobs (32766/7 - 80 where 80 is for overhead of project default directory) or 5380 server jobs (32766/6 - 80). In practice, the number might be smaller due to subdirectories not counted above, such as directories created by QualityStage jobs.
Symptom
When the maximum number of subdirectories is reached in the project directory, an error similar to below can occur when trying to save a newly created job:
Error On CREATE.FILE command
Creating file "RT_CONFIGnn as type 30, mkdbfile: connot create file
RT_CONFIG4817. Unable to create operating system file "RT_CONFIG4817"
Where nn is the job number of the newly created job.
Log InLog in to view more of this document
Was this topic helpful?
Document Information
Modified date:
25 April 2025
UID
swg21611379