Considerations for a Large Number of Watch Directories

There are two considerations when watching a very large number of directories: scan time and log space. Sterling Connect:Direct® File Agent scans each watch directory, then waits for the time specified in the watch interval, then repeats the cycle. With a large number of watch directories, each scan takes more time.

To keep each log file at a manageable size yet still keep enough current log data, the logging system uses a combination of MaxFileSize and MaxBackupIndex settings in the log4j.properties file to control logging. The MaxFileSize setting allows each file to grow only to a specified size, and the MaxBackupIndex setting specifies how many backup files are allowed. Multiplying these two settings will give you the maximum amount of disk space. Since there are three different logs, you would add the maximum disk space for each enabled log to get the maximum disk space for all Sterling Connect:Direct File Agent logging.

You can modify the MaxFileSize and MaxBackupIndex for each log to meet your requirements. The MaxFileSize recommended upper limit is 32MB. The MaxBackupIndex can be as large as you want and depends on how much log history to keep and the available disk space.