Uploading files by web upload

You can upload files to the platform from the Upload Files page.

About this task

Important:

Files that are uploaded through the Upload Files page are checked against the system pipeline filename patterns, which covers the universal filename patterns for account data, meter data and attachments. For more information, see Setting up Data Flow Automation and Data Flow Automation system pipelines.

If you are using a connector to transform and load data, you must create a custom data pipeline to process the files. If a file fails to match either the system pipeline filename patterns, or a custom data pipeline filename pattern, then the file is assumed to contain account data and is processed accordingly.

The default size limit for loading data files and attachments through data flow automation is 50 MB. However, data files can be limited by other factors such as the Excel maximum row count. Whenever possible, use smaller file sizes for data loading. For large files, split the files into smaller files for faster processing and easier troubleshooting.

The latest version of the Upload Files page provides the following improvements:
  • Displays both the original filename and, for files that are loaded and transformed through a connector such as IBM App Connect, the transformed filename.
  • Visibility of file processing and loading status. A loading status value of Loaded with errors indicates that some of the rows in a file were not loaded and you should check the load errors in the File Loading Logs page.
  • Direct access to file processing and loading details.
  • Visibility of the number of skipped rows, non-informational parse errors, load errors, and alerts.

The Upload Files page shows all files uploaded in the last 24 hours by default. You can apply filters to your view of the data, for example, to see the last 7 days of files.

For more information about troubleshooting uploaded files, see Troubleshooting uploaded files.

Procedure

  1. From the main menu, click Manage > Upload Files.
  2. Click Upload and browse to select the file.
  3. Click Upload File.

What to do next

When the file is uploaded, you can check the status of the file processing and loading in the grid. You might need to refresh the page to see the latest status. You can also download a copy of the original and transformed file.

The loading status indicates whether a file has either loaded successfully, failed, or loaded with errors. To view more information about the file, such as the compilation status and detailed error logs, click Actions and select Loading Logs.

For account data files, after the file has loaded, to view all loaded records click Actions and select View Records. You can also click Actions and select View Alerts to review any alerts that are triggered by account style threshold or variance rules.