November 3, 2016 | Written by: Neil Parrott
Share this post:
Depending on where you look, between 80% to more than 90%of corporate data is unstructured. The explosion of business, social and other user generated content continues to generate an influx of unstructured data that makes previous information volumes seem like a slow trickle in comparison.
It is widely known that per Terabyte storage costs are declining. However, data is being generated at a much faster pace. Since unstructured data, also known as content, is exploding at a faster rate than structured data, organizational storage costs are actually increasing.
MarketsAndMarkets predict the global Cloud storage market will grow from USD 18.87 Billion in 2015 to USD 65.41 Billion by 2020, at a Compound Annual Growth Rate (CAGR) of 28.2%.
According to icrunchdata, “by 2020, companies will need to manage 50 times more data with only a tiny (1.5 percent) increase to IT staffing. What’s more, the rise of unstructured data will far outpace its structured counterpart.”
Managing the Content Lifecycle
Managing the content lifecycle by applying retention and disposition policies is not only good business practice, but it can also help to reduce overall storage requirements and costs.
Solutions like IBM Enterprise Records can be used to classify, store, secure and preserve content that has been made final and is no longer meant to be altered. However, these records may only constitute a fraction of the overall content within an Enterprise Content Management system. What to do about the rest of your enterprise content?
Handling bulk processing with Sweeps
Sweeps is a powerful bulk processing capability built into IBM Content Foundation and IBM FileNet Content Manager V5.2 and newer. Sweeps can automate and simplify bulk operations for a wide variety of content lifecycle activities including the removal of unwanted content. Examples include:
- Execute a background search for target content
- Set time-based or event-based retention on the search results
- Manage and update content retention based on changing requirements
- Clean up and remove unwanted content. E.g., minor document versions and unclassified content
- Move infrequently accessed content to cheaper storage
- Delete content that has reached the end of its retention period
Sweeps can be used for much more than managing the content lifecycle. Sweeps can automate and manage a wide variety of bulk processing activities. Examples include:
- Reclassify existing content
- Classify newly federated content
- Reapply or update document security
- Rebalance queue workloads
- Generate system usage reports
For additional information about Sweeps and related topics, see Handling bulk processing with sweeps and Retaining objects in IBM Knowledge Center. Register here to attend one of the complimentary workshops in Ehningen Germany or Atlanta, USA to update yourself on these capabilities and more!