Skip to main content

Application Integration::Population=Multi Step variation::Runtime patterns

Population=Multi Step variation::Runtime pattern

Population=Multi Step variation::Runtime pattern Data Server Services Data Server Services Population Population Population
Design Last Updated: 10-20-2004
(Click a node to get a detailed explanation.)

The major difference in this variation is that the Population node in the basic Population runtime pattern shown here is now split into three steps, representing a common reality that population may often be sufficiently complex to require separate nodes to handle the three different steps of Gather, Process, and Apply.

The figure above also shows how all functional elements may occur one or multiple times. Thus, a single Gather node may access data on multiple Data Server/Services nodes. This is similar for the Apply node. A single Process node may invoke multiple Gather or Apply nodes as required (not shown in the figure above). In addition, there may be multiple Process nodes involved. However, a real-life implementation is unlikely to be as complex as this; a suitable subset of these nodes will usually suffice.

Grouping of different population functions also varies by product and implementation. In some case, Process and Apply functions may be collocated on a single node. In other cases, Process and Gather may reside together. These product-driven variations need to be considered in the final design.

Data Server/Services

A Data Server/Services node is a generic data storage node that provides managed, persistent storage of any type of data and a means to directly access and manipulate that data. The data may be stored in files and accessed through file I/O routines or may be stored in a database with more structured and managed access methods.

Population

A population node is a specialized application or data server that is optimized for record-oriented processing where the records must be gathered from one or more source data sets, processed singly and multiply and finally applied to one or more target data sets. A population node typically operates in an "off-line" mode to prepare data in advance of its business usage and based on rules that have been previously defined through a separate user interface module and stored in a metadata repository.

A population server may be further specialized for one or two of its inherent sub-functions--gather, process or apply (also known as extract, transform and load respectively). Such specialization may be for reasons of performance or physical placement.