Periodically verify that the correct knowledge base categories and decision plan actions were applied during classification by reviewing documents in the Classification Center. By reviewing documents, you can improve the classification of documents in the future because the system stores your selections as possible feedback.
As part of the normal course of activity, audit the classification of a random sample of documents that are moved or copied to an audit folder. To direct documents to an audit folder, you must first create an appropriate rule in your decision plan to flag documents for auditing. Use the advanced random trigger option in Classification Workbench to build a rule that randomly flags a specific percentage of documents to move or copy into an audit folder for review. For example, create a rule that is triggered for 5% of the documents that are processed and sets the CopyToAuditFolder content field to True. Besides defining this decision plan rule, you also need to set up a procedure for moving or copying the flagged documents to a special audit folder. If the audit folder contains only copies of the documents, you can delete these copies after you complete the audit. Alternatively, you can define a rule that moves a percentage of documents into an audit folder for review. For instructions, see Example using advanced triggers and actions.
If you find a document for which the decision plan actions are not correctly applied, you can reclassify the document by using one or both of the following reclassify options:
If the decision plan changed since the time that the document was last classified, reclassify the document by using the current version of the decision plan. Changes to the decision plan include the addition of a new decision plan rule, or feedback was applied to any of the referenced knowledge bases. If you want to see detailed information about the rules that are triggered when the document is reclassified, select the Generate detailed trace information option. For each rule that is triggered, you can see which classification actions succeeded and can be applied, as well as which classification actions were skipped and cannot be applied.
If the correct actions are not applied after using the first option, reclassify the document by selecting specific knowledge base categories that you think are most appropriate for classifying the document.
If the correct actions are still not applied after using the second option, determine whether the decision plan needs to be updated to handle this type of document or whether this document is an exception to a rule that cannot be changed without affecting overall performance. Use the detailed trace information that was generated to help determine which rules need to be modified. Save the document in XML format so that you can import the document into Classification Workbench and use the document to verify the modified decision plan. You might also want to add this document to the data set that you use for periodic regression tests.
