Loading and streaming data

Before you can perform a search on log or other data, you must first load the data into IBM® Operations Analytics Log Analysis. When the file is loaded the data is indexed and is then available to be searched.

There are two main scenarios for loading data:
  • Batch loading historic data. For example, you may want to ingest historic log data in a single batch for analysis or for testing. For more information, see Loading batches of data.
  • Streaming data from a monitored application. You may want to load data that is streamed from a local or remote server. You can use a number of different tools to stream data.

For more information about the tools that you can use to load data, see Data collection tools.

Note: You must create a Data Source before you configure data loading. For information about creating a Data Source, see Data Source creation.

Limitations

You cannot use IBM Operations Analytics Log Analysis to index log records that contain non-ASCII characters. If your log records contain non-ASCII characters, the records are not added when you use the IBM Tivoli® Monitoring Log File Agent or the Data Collector client. When you use the Data Collector client errors that relate to non-ASCII characters are added to the Generic Receiver log.