Operator SparkDecisionTree

Primitive operator image not displayed. Problem loading file: ../../image/tk$com.ibm.streamsx.sparkmllib/op$com.ibm.streamsx.sparkmllib.tree$SparkDecisionTree.svg

This operator provides support for analysis of incoming tuple data against Apache Spark's decision tree machine learning library.

Summary

Ports
This operator has 2 input ports and 1 output port.
Windowing
This operator does not accept any windowing configurations.
Parameters
This operator supports 4 parameters.

Required: modelPath, testDataAttr

Optional: params, sparkMaster

Metrics
This operator does not report any metrics.

Properties

Implementation
Java

Input Ports

Ports (0)

This input port is required. The operator expects an attribute of type list<float64> that will be used as input to the decision tree algorithm.

Properties
Ports (1)

This input control port is optional. The port expects a single attribute of type rstring and the value must be a string in JSON format. For example, to reload the spark model, the attribute value must be set to '{"reloadModel":true}'.

Properties

Output Ports

Assignments
Java operators do not support output assignments.
Ports (0)

This output port is required. The operator passes through all attributes on the input port as-is to the output port. In addition, it expects an attribute called 'analysisResult' of type float64.

Properties

Parameters

This operator supports 4 parameters.

Required: modelPath, testDataAttr

Optional: params, sparkMaster

modelPath

The path containing the persisted analytic model

Properties
params

The parameters to be passed to the spark configuration as a comma-separated list of 'key=value'

Properties
sparkMaster

The spark master to use during the analysis. If not specified, the default value is 'local'

Properties
testDataAttr
Properties

Libraries

Operator class library
Library Path: ../../lib/streams-sparkmllib.jar, @SPARK_HOME@/jars/*