evaluationnode properties

Evaluation node iconThe Evaluation node helps to evaluate and compare predictive models. The evaluation chart shows how well models predict particular outcomes. It sorts records based on the predicted value and confidence of the prediction. It splits the records into groups of equal size (quantiles) and then plots the value of the business criterion for each quantile from highest to lowest. Multiple models are shown as separate lines in the plot.

Example

stream = modeler.script.stream()
typenode = stream.findByID("id42KW3MSA94B")

node = stream.create("evaluation", "My node")
stream.link(typenode, node)

# "Plot" tab
node.setPropertyValue("chart_type", "Gains")
node.setPropertyValue("cumulative", False)
node.setPropertyValue("field_detection_method", "Name")
node.setPropertyValue("inc_baseline", True)
node.setPropertyValue("n_tile", "Deciles")
node.setPropertyValue("style", "Point")
node.setPropertyValue("plot_score_fields", True)
node.setPropertyValue("score_fields", ["Na", "K", "Age"])
node.setPropertyValue("use_fixed_cost", True)
node.setPropertyValue("cost_value", 5.0)
node.setPropertyValue("target_field", "Drug")
node.setPropertyValue("cost_field", "Na")
node.setPropertyValue("use_fixed_revenue", True)
node.setPropertyValue("revenue_value", 30.0)
node.setPropertyValue("revenue_field", "Age")
node.setPropertyValue("use_fixed_weight", True)
node.setPropertyValue("weight_value", 2.0)
node.setPropertyValue("weight_field", "K")
Table 1. evaluationnode properties
evaluationnode properties Data type Property description
chart_type Gains
Response
Lift
Profit
ROI
ROC
 
inc_baseline flag  
field_detection_method Metadata
Name
 
use_fixed_cost flag  
cost_value number  
cost_field string  
use_fixed_revenue flag  
revenue_value number  
revenue_field string  
use_fixed_weight flag  
weight_value number  
weight_field field  
n_tile Quartiles
Quintles
Deciles
Vingtiles
Percentiles
1000-tiles
 
cumulative flag  
style Line
Point
 
point_type Rectangle
Dot
Triangle
Hexagon
Plus
Pentagon
Star
BowTie
HorizontalDash
VerticalDash
IronCross
Factory
House
Cathedral
OnionDome
ConcaveTriangle OblateGlobe
CatEye
FourSidedPillow
RoundRectangle
Fan
 
export_data flag  
data_filename string  
delimiter string  
new_line flag  
inc_field_names flag  
inc_best_line flag  
inc_business_rule flag  
business_rule_condition string  
plot_score_fields flag  
score_fields [field1 ... fieldN]  
target_field field  
use_hit_condition flag  
hit_condition string  
use_score_expression flag  
score_expression string  
caption_auto flag  
split_by_partition boolean If a partition field is used to split records into training, test, and validation samples, use this option to display a separate evaluation chart for each partition.
use_profit_criteria boolean Enables profit criteria.
use_grid boolean Displays grid lines.