Troubleshooting data ingestion errors
During the data ingestion process you might encounter various types of errors. For example, process exception errors can occur during the file forwarding or file transformation process. It is important to understand the cause of these errors and to troubleshoot them without delay.
Process exceptions
When you forward or exchange files, errors can occur that you can raise as exceptions. Then, you can raise these exceptions as counter or summary metrics. Also, you can configure an alert on your monitoring system to inform you of these errors.
Error | Cause | Action |
---|---|---|
FX1059: Exception on moving object. FX1060: - exception message. If the exception message is Access Denied. FX1061: Exception on deleting object FX1062: - message FX1092: Exception on downloading object - message |
If the message is Access Denied, the required service access role is not included in the user credential that is configured in the file ingestion source rule. | Ensure that you include the required service access role in the credential that you provide in the file ingestion rule source. |
FX 1091: Exception on uploading object | If the message is Access Denied, the required service access role is not included in the user credential that is configured in the file ingestion source rule. | Ensure that you include the required service access role in the credential that you provide in the file ingestion rule source. |
FX1064: CSV validation failure for <n> rows | This error is logged during the CSV file transformation process when the file row values don’t match the schema that is configured for the file ingestion rule. The CSV file data must adhere to the data type and format that is defined in the schema. This error also appears in the log with the number of rows that are failed to match the schema definition. | In Sterling Intelligent Promising a /failed prefix is created for any CSV row that fails to process, and it is placed in a file for download and review. Also, a data ingestion summary file is created to help you troubleshoot any errors. |
FX 1068 Validation failed for the entire CSV file | This error is logged from the CSV file transformation process. All the rows in the CSV file failed to match the schema specifications for the file ingestion rule. The attributes in the CSV file must adhere to the number of attributes that are defined in the schema. Rows are not transformed if the CSV file has fewer values than those values in the CSV format. Similarly, all the rows that have a greater number of values are also not transformed. This error usually occurs when either the schema or the CSV file is new and the CSV file is generated from an old schema or CSV file. | In Sterling Intelligent Promising a /failed prefix is created for any CSV row that fails to process, and it is placed in a file for download and review. Also, a data ingestion summary file is created to help you troubleshoot any errors. |