Initial data load

You must perform an initial load dataflow to load existing data into the data mart. These dataflows load data from transaction tables and their history tables. You can set properties such as filters and load interval, to improve the performance of the ETL process that occurs during load management. Initial data load is used to bring data into the data warehouse the first time. For loading existing data into data mart, the configuration, master, and transaction tables are used.

Because the initial data load is a long-running and memory-intensive process, you must control the amount of data that is loaded in order to avoid running into out-of-memory exceptions. This can be done using filters and load interval properties.

Loading initial data into the staging database

If you have deployed a sharded environment, it is recommended that you create a staging database. The following configuration, master, and transaction tables enables you to load data into the staging database:
  • Configuration Tables
    • YFS_CATEGORY_DOMAIN
    • YFS_CAT_DOMAIN_LOCALE
    • YFS_CHARGE_CATEGORY
    • YFS_COMMON_CODE
    • YFS_DATA_SECURITY_GROUP
    • YFS_DOCUMENT_PARAMS
    • YFS_HOLD_TYPE
    • YFS_LOCALIZED_STRINGS
    • YFS_ORGANIZATION
    • YFS_PAYMENT_TYPE
    • YFS_PERSON_INFO
    • YFS_REGION
    • YFS_REGION_BEST_MATCH
    • YFS_REGION_SCHEMA
    • YFS_REGION_USAGE
    • YFS_STATUS_MODIFICATION_TYPE
  • Master Tables
    • YFS_CATEGORY
    • YFS_CATEGORY_ITEM
    • YFS_CATEGORY_LOCALE
    • YFS_CUSTOMER
    • YFS_CONSUMER
    • YFS_CUSTOMER_CONTACT
    • YFS_ITEM
    • YFS_ITEM_LOCALE
    • YFS_PERSON_INFO
    • YFS_USER
    • YFS_USER_GROUP_LIST
  • Transaction Tables
    • YFS_CHARGE_TRANSACTION
    • YFS_LINE_CHARGES
    • YFS_OPPORTUNITY
    • YFS_ORDER_HEADER
    • YFS_ORDER_LINE
    • YFS_ORDER_RELEASE_STATUS
    • YFS_ORDER_DATE
    • YFS_ORDER_LINE_SCHEDULE
    • YFS_ORDER_HOLD_TYPE
    • YFS_ORDER_HOLD_TYPE_LOG
    • YFS_ORDER_AUDIT
    • YFS_ORDER_AUDIT_LEVEL
    • YFS_PAYMENT
    • YFS_PERSON_INFO
    • YFS_SHIPMENT
    • YFS_SHIPMENT_LINE

If you are using Infosphere Datastage, refer to IBM InfoSphere Information Server documentation for more information about loading data into the database. If you are using any other ETL tool, refer to the corresponding product documentation for more information.