|
|
The Evaluation node helps to evaluate and compare predictive models. The evaluation chart
shows how well models predict particular outcomes. It sorts records based on the predicted value and
confidence of the prediction. It splits the records into groups of equal size (quantiles) and
then plots the value of the business criterion for each quantile from highest to lowest. Multiple
models are shown as separate lines in the plot.
|
Example
node = stream.create("evaluation", "My node")
# "Plot" tab
node.setPropertyValue("chart_type", "Gains")
node.setPropertyValue("cumulative", False)
node.setPropertyValue("field_detection_method", "Name")
node.setPropertyValue("inc_baseline", True)
node.setPropertyValue("n_tile", "Deciles")
node.setPropertyValue("style", "Point")
node.setPropertyValue("point_type", "Dot")
node.setPropertyValue("use_fixed_cost", True)
node.setPropertyValue("cost_value", 5.0)
node.setPropertyValue("cost_field", "Na")
node.setPropertyValue("use_fixed_revenue", True)
node.setPropertyValue("revenue_value", 30.0)
node.setPropertyValue("revenue_field", "Age")
node.setPropertyValue("use_fixed_weight", True)
node.setPropertyValue("weight_value", 2.0)
node.setPropertyValue("weight_field", "K")
Table 1. evaluationnode properties
evaluationnode properties |
Data type |
Property description |
chart_type |
Gains
Response
Lift
Profit
ROI
ROC
|
|
inc_baseline |
flag |
|
field_detection_method |
Metadata
Name |
|
use_fixed_cost |
flag |
|
cost_value |
number |
|
cost_field |
string |
|
use_fixed_revenue |
flag |
|
revenue_value |
number |
|
revenue_field |
string |
|
use_fixed_weight |
flag |
|
weight_value |
number |
|
weight_field |
field |
|
n_tile |
Quartiles
Quintles
Deciles
Vingtiles
Percentiles
1000-tiles |
|
cumulative |
flag |
|
style |
Line
Point |
|
point_type |
Rectangle
Dot
Triangle
Hexagon
Plus
Pentagon
Star
BowTie
HorizontalDash
VerticalDash
IronCross
Factory
House
Cathedral
OnionDome
ConcaveTriangle
OblateGlobe
CatEye
FourSidedPillow
RoundRectangle
Fan
|
|
export_data
|
flag
|
|
data_filename
|
string
|
|
delimiter
|
string
|
|
new_line
|
flag
|
|
inc_field_names
|
flag
|
|
inc_best_line |
flag |
|
inc_business_rule |
flag |
|
business_rule_condition |
string |
|
plot_score_fields |
flag |
|
score_fields |
[field1 ... fieldN] |
|
target_field |
field |
|
use_hit_condition |
flag |
|
hit_condition |
string |
|
use_score_expression |
flag |
|
score_expression |
string |
|
caption_auto |
flag |
|
