Contains valid link evaluation metric

The contains valid link metric measures whether the rows in the prediction contain valid links.

Metric details

Contains valid link is a content validation metric that uses string-based functions to analyze and validate generated LLM output text. The metric is available only when you use the Python SDK to calculate evaluation metrics.

Scope

The contains valid link metric evaluates generative AI assets only.

  • Types of AI assets: Prompt templates
  • Generative AI tasks:
    • Text summarization
    • Content generation
    • Question answering
    • Entity extraction
    • Retrieval augmented generation (RAG)
  • Supported languages: English

Scores and values

The contains valid link metric score indicates whether the predication rows contain valid links.

  • Range of values: 0.0-1.0
  • Ratios:
    • At 0: The prediction rows do not contain valid links.
    • At 1: The prediction rows contain valid links.

Settings

  • Thresholds:
    • Lower limit: 0
    • Upper limit: 1