Building an IBM Optim Archive flow

Use the IBM Optim Archive flow builder to configure, modify, and run flows. When flows are complete, you can then run them as jobs to create and export data sets and archives.

A flow defines the end-to-end process of extracting data from source systems, optionally applying subsetting and masking, and loading the data into target environments or archive files.

You can build flows step-by-step on the flow builder canvas by dragging-and-dropping existing nodes, such as connection profiles, access definitions, subsets, and masking policies, and then defining the target node. You can also create new nodes directly from within the flow builder.

Each flow contains the sequential steps required to configure and execute a data export job:

1. Create source and target connections: Before building a flow, ensure that you have defined connections to both your source and target databases. These connections enable access to the data that will be extracted and the destination where it will be loaded. For details, see Creating a connection.
2. Add an access definition: Create an access definition for your connection by dragging an Access definition node onto your canvas. Access definitions specify the tables and relationships to be extracted from the source system. For details, see Creating an access definition.
3. Add subsetting (optional): Drag a Subset node onto your canvas to apply subsetting conditions to filter rows from source tables. Subsetting helps to reduce data volumes and focus on relevant records for testing or development. For details, see Applying subsetting conditions.
4. Add a masking definition (optional): Drag a Mask node onto your canvas to apply masking policies to sensitive fields to ensure data privacy and compliance. Masking transforms personally identifiable information while preserving data format and usability. For details, see Applying masking policies and Previewing masked data.
5. Define the target: Drag a Target node onto your canvas to define the target location and configure export options. This includes selecting the destination schema and specifying how data should be handled. For details, see Defining a target.

Additionally, after running a flow to start an export job, you can monitor its progress and review logs to validate outcomes and troubleshoot any issues. For more information, see Viewing job details, logs, and process reports.