Configuring Insight Packs

If you want to integrate your Insight® Packs with the scalable data collection architecture, you need to update the scalable data collection configuration.

Insight Packs use various different tools and methods to collect and annotate data. Data can be collected by the IBM® Tivoli® Monitoring Log File Agent or Logstash. Annotation can be done in Logstash or in Log Analysis. Some Insight Packs use the LFA to collect data and annotate it in Logstash before it is sent to Log Analysis.

The Insight Packs that are available for Log Analysis can be grouped into the following types based on the data collection tools that they use and where the data is annotated:
IBM Tivoli Monitoring Log File Agent (LFA) collects data and Log Analysis annotates it
These types of Insight Pack use local or remote instances of the LFA to stream log file data to Log Analysis. The data is annotated according to the logic defined in the Insight Pack on the Log Analysis server. The WebSphere® Application Server Insight Pack is one example of this type.

For more information, see Configuring Insight Packs that use the LFA to stream data and Log Analysis to annotate it.

LFA collects data and Logstash annotates it
These types of Insight Packs use both the LFA and Logstash. The LFA sends the log file data to Logstash, where it is annotated according to the logic defined in the Logstash configuration and sent to Log Analysis. The SAP HANA Insight Pack is one example of this type.

For more information, see Configuring Insight Packs that use LFA to load data and Logstash to annotate it.

Logstash collects data and annotates it
These types of Insight Packs use Logstash to stream data to Log Analysis. The data is annotated according to the logic defined in the Logstash configuration for the Insight Pack. The Oracle DB Alert Insight Pack is one example of this type.

For more information, see Configuring Insight Packs that use Logstash to stream data and annotate it.

Custom data collection agent collects data and Log Analysis annotates it
These types of Insight Packs use custom built agents to collect data. The data is sent to Log Analysis through the REST API. The data is annotated according to the logic defined in the Insight Pack on the Log Analysis server. The NetApp OnTap Insight Pack is one example of this type. This type of Insight Pack is not supported by the scalable data collection architecture.

If you do not integrate your Insight Packs with the scalable data collection architecture, they will continue to function. However, they will not enjoy the benefits of the architecture.