Data Integrity Process File
Digital Analytics uses the Data Integrity Process (DIP) to validate the data being collected by the IBM® Digital Analytics tagging.
DIP compares data directly imported from your backend database to the data collected and used by Digital Analytics reporting. Data is imported through the upload of a DIP file, which is sent via SFTP to Digital Analytics on a daily basis. This feature is not available in Test reporting.
DIP File Format
The DIP file is a comma separated values (CSV) file that contains line item data for all orders placed for the day. Each line has six values: Order Date, Order ID, Product ID, Order Subtotal, Quantity, and Unit Price.
| Column | Description |
|---|---|
| Order Date | Date of the order in appropriate format (see Section 8.2.3) |
| Order ID | Order ID should match the Order ID being sent in the Digital Analytics Order Tag. |
| Product ID | Product ID for the line item. This should match the Product ID being sent in the Shop 9 Tag. |
| Order Subtotal | Subtotal for the order. This should not include shipping and handling or tax. |
| Quantity | Quantity of the product purchased for this line item. |
| Unit Price | Unit price for the line item. |
No quotes should exist anywhere within the DIP file. The DIP file should contain data for all orders placed online that would be tracked with Digital Analytics. It should not include any orders placed from other channels, such as store, catalog, or call center/telephone sales. Do not include commas in Order Subtotal or Unit Price values.
Date Formatting
The Order Date should be in the same time zone as your Digital Analytics reports were set up to. They should not be translated to CST. If you have any questions about what time zone is appropriate, please contact your Implementation Engineer. The Order Date field must be in one of the following formats:
DD-MON-YYYY HH24:MI:SS
YYYY-MM-DD HH24:MI:SS
MM/DD/YY HH24:MI:SS
MM/DD/YYYY HH24:MI
DD-MON-YYYY HH24:MI:SS
MM/DD/YYYY HH24:MI:SS
DD-MON-YYYY
MM-DD-YYYY HH24:MI:SSExample File
Below is an example set of order data for one day and the corresponding DIP file entries.
| Order Date | Order ID | Product ID | Order Total | Qty | Unit Price |
|---|---|---|---|---|---|
| 27-Oct-2010 13:32:17 | 5328031 | 47175 | 20.97 | 3 | 6.99 |
| 27-Oct-2010 14:12:05 | 5328032 | 156564 | 243.87 | 4 | 3.49 |
| 27-Oct-2010 14:30:07 | 5328032 | 187167 | 243.87 | 1 | 29.99 |
| 27-Oct-2010 14:55:46 | 5328032 | 185767 | 243.87 | 4 | 19.99 |
| 27-Oct-2010 14:59:43 | 5328032 | 186891 | 243.87 | 4 | 29.99 |
| 27-Oct-2010 15:10:23 | 5328034 | 188353 | 231.76 | 1 | 19.97 |
| 27-Oct-2010 15:19:53 | 5328034 | 188396 | 231.76 | 2 | 15.97 |
| 27-Oct-2010 15:24:31 | 5328034 | 188412 | 231.76 | 1 | 24.97 |
| 27-Oct-2010 15:43:14 | 5328034 | 188487 | 231.76 | 1 | 29.97 |
| 27-Oct-2010 16:03:28 | 5328034 | 188529 | 231.76 | 1 | 64.97 |
27-Oct-2010 13:32:17,5328031,47175,20.97,3,6.99
27-Oct-2010 14:12:05,5328032,156564,243.87,4,3.49
27-Oct-2010 14:30:07,5328032,187167,243.87,1,29.99
27-Oct-2010 14:55:46,5328032,185767,243.87,4,19.99
27-Oct-2010 14:59:43,5328032,186891,243.87,4,29.99
27-Oct-2010 15:10:23,5328034,188353,231.76,1,19.97
27-Oct-2010 15:19:53,5328034,188396,231.76,2,15.97
27-Oct-2010 15:24:31,5328034,188412,231.76,1,24.97
27-Oct-2010 15:43:14,5328034,188487,231.76,1,29.97
27-Oct-2010 16:03:28,5328034,188529,231.76,1,64.97Uploading the DIP File
The DIP file should be uploaded to IBM Digital Analytics' SFTP server for your data center. Depending on the Data Center and database type used by your Client ID, the SFTP account and SFTP target used to upload the DIP files will vary.
SFTP Target Domain
US Data Center: ftp.coremetrics.com
Europe Data Center: ftp.de.coremetrics.com
SFTP Account Type
For 5- or 9-series Client IDs worldwide, use a "clientid-import" account self-configured in the appropriate Import application UI for your Data Center: import.coremetrics.com (US), import.de.coremetrics.com (Europe).
For 9-series Client IDs using Oracle, use a "clientname-dip" account created by Digital Analytics Support.
Contact Digital Analytics Support to confirm which type of SFTP account should be configured for your Client ID.
File Naming Convention
DIP_<client_id>_<YYYYMMDD>.csv