Creating a streams flow manually

You can manually design a streams flow that best meets your data and analytic needs. Creating a streams flow manually gives you the greatest control over its design. This method gives you maximum flexibility to get the most value from your data. Use this method rather than the wizard when you have a more complicated streams flow.

You don’t need to get involved in creating the streams flow – we do that for you. You need to set up the source, target, analytic, and alert operators.

For example, you can add multiple sources and targets to your streams flow. Based on real-time analytics that you need to perform, you can aggregate, filter, and run your own code. You can even send email notification to interested parties from strategic places in your streams flow! If needed, you can perform real-time analysis on the streaming data, and then store selected data in a target for further analysis later.

Watch the following video to see how to create a streams flow manually in the streams flow canvas.

This video provides a visual method as an alternative to following the written steps in this documentation.

Prerequisites

The source data can be in any format, including binary data. If the source format is in JSON format, it can be parsed automatically, see Parsing values from JSON. Or, you can parse it using a Code operator.

You must have either the Editor role or the Admin role.

The following instances must be associated with the project where the streams flow runs:

• Streams instance

Procedure

To manually create a streams flow, perform the following steps:

1. In the Projects menu, click View All Projects, and then click the name of the project to add your streams flow to. Alternatively, to create a project for the streams flow, click New project.

2. In the Project page, click the Assets tab, and then click New streams flow.

3. In the Blank tab of the New Streams Flow page, type in a unique name. Click Manual, and then click Create.

4. Construct your streams flow by using the streams flow editor.

5. Click the Save icon to save the streams flow, and then click the Metrics icon to open the streams flow in the Metrics page.

6. In the Metrics page, the newly created streams flow is shown. Click the Run icon to begin streaming.

Learn more

• Troubleshooting streams flow
• How data types are handled in a streams flow
• JSON path
• Aggregation examples
• Code operator examples
• Filter operator examples
• Python Model operator
• Installing other Python packages
• MQTT operator
• HTTP operator
• Streams operators
• Kafka operators