Runtime column validations (InfoSphere Streams connector)
You can validate extra columns when the InfoSphere Streams connector is used as a source or as a target using the Schema reconciliation property.
Validating extra columns when used as a source stage
- If there are any additional columns on the link that do not map to attributes of the tuple, the connector might issue a warning at initialization time that link has unmatched columns, or it might fail the job. The property Usage > Schema reconciliation > Unmatched columns determines whether this conditions is ignored, or results in a warning or job failure. The connector drops any unmatched column from the schema.
- If there are attributes in the tuple that do not match to columns , the connector might issue a warning message at initialization time that the attributes are ignored, or it might fail the job. The property Usage > Schema reconciliation > Unmatched attributes determines whether this condition is ignored, or results in a warning or job failure. This feature allows a user to ignore tuple attributes that are not of interest by excluding them from the design schema, and hence to improve the performance of the job.
- If there are attributes in the tuple that do not match to columns, the connector does not issue a warning message at initialization time and all attributes of the tuple are sent to the output link.
Validating extra columns when used as a target stage
- If there are additional columns on the link that do not map to attributes of the tuple, the connector might generate a warning at initialization time that the link has extra columns, or it might fail the job. The property Usage > Schema reconciliation > Unmatched columns determines whether this conditions is ignored, or results in a warning or job failure.
- If there are attributes in the tuple that do not match to columns, the connector might issue a warning message at initialization time that there are unmatched attributes, or it might fail the job. The property Usage > Schema reconciliation > Unmatched attributes determines whether this conditions is ignored, or results in a warning or job failure.