IBM Streams 4.2

Monitoring data flow in an application

To monitor the current flow of data in your application, use a set of color schemes and apply these color schemes in sequence.

About this task

To monitor the data flow, start with the Flow color schemes. Depending on the number of tuples that are processed per second, the Flow color scheme colors operators and streams. The colors are assigned to an increasing range of values, starting from 0 to indicate that no data flows through the application to values greater than 100,000 tuples per second. Operators and streams that are colored black indicate that there is no data flow, and you must investigate these operators further.

Procedure

  1. In the Instance Graph view, in the Color Schemes pane, select Flow. All stream and operators in your application are colored based on the number of tuples that are processed per second. Streams and operators can change color as the flow rates are sampled and determined. Fast flowing streams are indicated with a thicker colored line to represent heavier flow.
  2. To highlight possible areas of concern and identify slow flowing operators and streams, apply the following coloring schemes in sequence:
    1. In the Instance Graph view, in the Color Schemes pane, select Flow Under 1000. This color scheme colors only those operators where the flow rate is 1000 tuples per second or less.
    2. In the Instance Graph view, in the Color Schemes pane, select Flow Under 100. This color scheme colors only those operators where the flow rate is 100 tuples per second or less.
  3. If over several refresh cycles, operators and streams are colored black, apply the following color schemes to investigate the problem:
    1. To ensure that connections are healthy, in the Instance Graph view, in the Color Schemes pane, select Health.
    2. To ensure that an operator is generating output data, in the Instance Graph view, in the Color Schemes pane, select nTuplesSubmitted.
    3. To ensure that an operator is receiving input data, in the Instance Graph view, in the Color Schemes pane, select nTuplesProcessed.
      Note: If an operator does not receive input data, use the highlighting options in the instance graph to trace the last upstream operator that received data and check all the operators from that point.
    4. To ensure that final punctuation was not sent, in the Instance Graph view, in the Color Schemes pane, select nFinalPunctsubmitted. If a stream sends a final punctuation, it indicates the end of the stream and no tuples are produced by the stream.

Results

Slow flow rates
If data is flowing slower than expected, examine the operators to verify whether there is a problem with filter expressions. Slow flow rates can also indicate congesting in streams.
No data flow
If no data flows through your application, use the highlighting options in the instance graph to identify the operators and streams that are involved in the flow. To determine the cause, use the highlighting options to trace the last upstream or downstream operator that received or output data and examine the flow from that point.