Run data extract for ad hoc retrieval requests

You can adjust the data extract process to retrieve data from the production backup database for your ad hoc requirements.

The guidelines that are listed out in this topic assume that you have a data extract service that is configured and it supplies regular feeds to the external application. For more information abut setting up the data extract configuration service, see Data extract configuration service.

This data extract process is modeled as a time-triggered transaction (an agent) and the data extract process is run asynchronously on a separate JVM (an agent server). Each extract operation is triggered by a criteria that are configured on the agent and scheduled to run at regular intervals of time. For example, 30 minutes.

Call the application-provided service CocDataExtractConfig to configure the tables and corresponding columns to extract and set the frequency of extract. This service also takes a parameter to read how many days of old data should be extracted for the first run. The data extract is a continuous operation and scheduled to run at regular intervals. After the first run, it always keeps track of the previous attempt and extracts records, which are added or modified after last extract only. The data is extracted in the CSV format, compressed, and sent to the file storage service. For more details, see Data extract overview.