DQM rules
DQM rules are configured system-defined repair, clean up, and standardization functions applied to incoming identity data values in a specific order.
DQM rules define how the system processes the incoming data and are designed to properly format numbers, identify and correct clerical or transposition errors, and identify and correct intentional inaccuracies introduced by those intent on trying to conceal their identities. DQM rules can perform a variety of repair, clean up, and standardization functions on incoming identity data values.
To configure a DQM rule, you select a specific UMF segment (such as NAME) and UMF tag (such as NAME_TYPE), then you select a system-defined DQM function to apply to the incoming data, and finally you specify the associated parameters for that function, including any default values the system should apply. You also choose the order in which to apply this DQM rule on the selected UMF segment, since the product supports multiple DQM rules for each UMF segment.
- DQM function 110: Required value check
DQM function 110 determines if the value of the UMF tag is present, and not empty, for each segment of the configured data type. - DQM function 115: Capitalization check
DQM function 115 ensures that the value of the UMF tag is capitalized according to the specified format which can be initial capital letters, all capital letters, or no capital letters. - DQM function 130: Character find and replace
DQM function 130 replaces configured characters with a default replacement character string. - DQM function 131: Character find and remove
DQM function 131 removes configured characters from the value of the UMF tag. - DQM function 135: Format check
DQM function 135 compares the value of the UMF tag, if it is not empty, to a configured character mask format. This function allows the system to format values that need to be formatted as part of a pre-process function. - DQM function 140: Number format check
DQM function 140 compares the number of characters and the mask format of the value of a UMF number value tag to a configured number type. - DQM function 145: Append values
DQM function 145 concatenates an unlimited number of multiple string literals and/or UMF tag values into a single value. - DQM function 160: Maximum length check
DQM function 160 validates the length and truncates the value of the UMF tag. - DQM function 170: Prefix check
DQM function 170 verifies that the value of the UMF tag contains a required prefix value - DQM function 190: Value lookup
DQM function 190 validates that the value of a UMF tag matches a value in a configured lookup table. - DQM function 191: Exclude value
DQM function 191 validates that the value of the UMF tag does not exist in a the CODES lookup table - DQM function 200: Number validation
DQM function 200 verifies that value of the UMF tag is numeric and has a valid numerical format. - DQM function 204: Date validation and format
DQM function 204 validates the date and time format of the value of the UMF tag. - Deprecated: DQM function 205: date validation and format
This function validates that the UMF tag's value is a valid date and formats the date according to one of the available date formats. - DQM function 207: Convert date of birth to circa date of birth
DQM function 207 converts date values of January 1 to have circa date of birth characteristic types. - DQM function 210: Prevent zero value
DQM function 210 function ensures that the value of the UMF tag is not zero. - DQM function 220: Positive or negative check
DQM function 220 ensures that the numerical value of the UMF tag is the correct polarity, either positive or negative. - DQM function 230: Integer check
DQM function 230 ensures that the value of the UMF tag is a correct integer (non-decimal) value. - DQM function 240: Number range check
DQM function 240 ensures that the value of the UMF tag value is within a configured numeric/decimal range. - DQM function 252: Full name parsing
parses the value of the <FULL_NAME> UMF tag into all possible name parts and stores each of these values in a corresponding individual name part UMF tag. - DQM function 255: Name standardization
DQM function 255 generates name hashes by standardizing the name and building a hash of the standardized parts. - DQM function 258: Name gender determination
DQM function 258 dynamically determines the gender associated with an incoming UMF name and generates an <ATTRIBUTE> tag to include the associated gender with the UMF record. - DQM function 260: Name culture assignment
DQM function 260 determines the culture of the UMF <NAME> segment and stores the culture with the name using the <CULTURE> tag. - DQM function 282: Name variant hashes
DQM function 282 calls the IBM Global Name Recognition component libraries to parse the name, add the appropriate cultures to the name, and generate name variant hashes, which are added to the incoming UMF record as enhancements to the <NAME> segment. - DQM function 289: Alternate name parses
DQM function 289 generates alternate name parses for incoming UMF names. By default, this function is not configured. To generate alternate name parses, you must configure the function on the <NAME> segment. - DQM function 300: Date calculator
DQM function 300 determines the difference between two date/time values and stores that value in the UMF tag. - DQM function 305: Date range check
DQM function 305 verifies that the date value of the UMF tag is within a specified range. - DQM function 410: Advanced value lookup
DQM function 410 locates a value based on a dynamically created SQL statement.and stores it in the UMF tag value. - DQM function 420: Copy UMF tag value
DQM function 420 copies or moves the value of the UMF tag. - DQM function 450: Email address parsing
DQM function 450 parses an email address UMF tag value into the individual email components and generates the email key value. - Deprecated: DQM function 510: enhanced address key
This function generates an address key that contains both alpha and numeric characters. - DQM function 515: Address parser
DQM function 515 cleanses, parses, and hashes address values based on the locale of the address value. - DQM function 520: Approximate address key
DQM function 520 is used to convert an existing UMF <ADDR_HASH> tag value into a wild card key used to find approximate addresses that match an entity. - DQM function 551: Default role assignment
DQM function 551 finds a role based on an incoming record's data source and assigns that role to the incoming record. - DQM function 600: Data key
DQM function 600 appends any number of UMF tag values together, delimited by "|" (pipe) with all white space removed and all alpha characters made upper case. - DQM function 605: Name meta-phone generation
DQM function 605 uses the value of the UMF tag and generates the meta-phone representation for each word in the tag and adds the value to the segment as a new tag. - DQM function 610: Composite key segment creation
DQM function 610 combines a configured set of UMF tag values to create a new <ATTRIBUTE> segment. - DQM function 615: Generate a hash using a rules set
DQM function 615 generates a hash on a UMF segment using a specified hash rules set. - DQM function 660: DQM extender
DQM function 660 enables a UMF segment to be sent by the HTTP transport to a designated port for further external data quality processing. - Deprecated: DQM function 1010: Prefix/generation parsing
DQM function 1010 identifies and relocates potential name prefixes or name generations attached to the end of a name part.
Parent topic: Data Quality Management (DQM)