IBM® Instana® GenAI Observability brings AI monitoring into the same powerful workflows teams already use for their full-stack applications. It automatically discovers and maps agents, chains and tasks, then connects their data to the rest of your infrastructure. With built-in visibility into prompts, outputs, tokens, latency, cost and errors, teams can quickly trace issues, optimize performance and operate AI-driven apps with confidence.
Backed by OpenLLMetry standards, Instana supports leading providers and frameworks, including IBM watsonx.ai®, Amazon Bedrock, OpenAI, Anthropic, Groq, DeepSeek, LangChain, LangGraph and CrewAI, as well as runtimes like vLLM and GPUs. This open ecosystem approach keeps your AI observability portable, cost-aware and governance-ready, giving you end-to-end clarity from model to infrastructure without switching tools.
Features
Instana automatically discovers AI components, including agents, chains and tasks, and maps their relationships to services and infrastructure. This capability includes task hierarchy modeling and monitoring to visualize flows and pinpoint where issues originate.
Trace every step across agents, tool calls, retrievals and model invocations while correlating with traditional APM signals. Real-time incident investigation brings AI spans into the same timeline as microservices, databases and networks.
Track token usage and modeled cost at granular levels to optimize models, prompts and tenancy. Use these insights to prevent overruns and align expenditure with performance objectives.
Capture prompts and outputs (with configurable redaction), latency, throughput, error rates and model or provider metadata by using OpenLLMetry conventions. These operational signals can drive dashboards and alerts that help detect risky behavior and route it to the right owners.
Leverage native OpenLLMetry (Trace loop) instrumentation with coverage for major model providers and frameworks, GPUs and runtimes like vLLM. Keep AI data portable and vendor-neutral while unifying it with mature APM and infrastructure monitoring from Instana.
Understand your intricate infrastructure mapping through real-time cloud native application monitoring.
Solve issues before they impact your customers with AI-infused decision making.
Get enhanced visibility with Instana to make the most out of your AWS investment.