There are a number of different methods that you can use to load data into Log Analysis.
You can load batches of historical data or you can stream data from the server where it is
generated. You can use any of the following options to load a batch of data into Log Analysis:
The following graphic illustrates the various options for streaming data into Log Analysis:Figure 1. Data flow for data collection
You can also stream data from the server where it is generated. You can use any of the following
methods to stream data:
Remote server 1 (Local LFA)
In the first server, you configure the LFA that is installed with Log Analysis to stream data
from a remote server. The LFA is installed on the Log Analysis server and
configured to connect to the remote server. After it retrieves the data, it is sent to the EIF
Receiver that then sends it to the Generic Receiver. For more information, see Streaming data with the IBM Tivoli Monitoring Log File Agent.
Remote server 2 (Remote LFA)
In this example, you install an LFA on the remote server and use it to stream data to Log Analysis. The LFA can be
the one that is delivered with Log Analysis or it can be
one that is already installed as part of another installation. The LFA is installed on the remote
server and sends data to the EIF Receiver. For more information, see Streaming data from multiple remote sources across a network.
Remote server 3 (Remote EIF Receiver)
In this scenario, you install an instance of the EIF Receiver on the server that you want to
monitor. The EIF Receiver sends data directly to the Generic Receiver. You can need to do this if
you intend to stream a large volume of data. For more information, see Streaming data from multiple remote sources across a network.
Remote server 4 (Logstash output plugin)
In this scenario, you configure the Logstash plugin to retrieve data and send it directly to the
Generic Receiver.
Remote server 5 (Logstash)
In this scenario, you install and configure Logstash on the remote server to send data directly
to the Generic Receiver. For more information, see Streaming data with Logstash.
Remote server 6 (Scalable data collection architecture)
You can configure the scalable data collection architecture to process large volumes of data.
The architecture consists of a cluster of Logstash servers that preprocess data before it is sent to
Log Analysis. For
more information, see Deploying scalable data collection architecture.
Remote server 7 (IBM Cloud Application Performance Management, Private)
