Overview of IBM® watsonx Assistant for Z

IBM® watsonx Assistant for Z delivers a unified AI architecture that connects agents, services, and IBM Z systems to enable intelligent, secure automation across the enterprise.

watsonx Assistant for Z architecture

IBM watsonx Assistant for Z is powered by IBM watsonx Orchestrate® that is built on Red Hat® OpenShift® and IBM Software Hub Platform.

At the architectural level, watsonx Assistant for Z introduces an Orchestrator agent that directly connects IBM Z agents to MCP servers. This enables AI capabilities for a broad range of components across the IBM Z ecosystem, including Infrastructure, Middleware, Tools, third-party software, and custom applications, forming the foundation for scalable and secure enterprise operations.

watsonx assistant for z architecture diagram

The Orchestrator agent serves as the central hub of the watsonx Assistant for Z architecture. It coordinates interactions across all components, ensuring seamless communication and data flow. It connects to key services such as zRAG, Topology, and Identity Management, as well as both IBM and third-party software systems, enabling a unified and intelligent automation experience.

The system includes IBM Z Software agents embedded within IBM Z products, foundational agents that are ready for immediate deployment, third-party agents developed by external vendors, and custom agents created by users to meet unique operational needs. Together, these agents extend the platform’s flexibility and intelligence. To know more about the watsonx Assistant for Z agents, see AI agents and services in IBM watsonx Assistant for Z.

The chat interface allows users to engage with the system through conversational AI. It provides an intuitive and responsive conversational interface to access the platform’s capabilities.

Additionally, the architecture includes the following components:
  • Retrieval Augmented Generation (zRAG) - A component that augments LLM with the knowledge based on IBM Z documentation and creates IBM Z context aware responses to the questions.
  • Topology - The system topology feature interacts with z/OSMF APIs to collect information about the system’s structure and the versions of installed software. This foundational data helps users gain a basic understanding of their environment, which is essential for learning and managing IBM Z systems effectively.
  • Identity Management - Identity Management plays a vital role in ensuring system security and governance. It manages user identities and enforces access controls, allowing only authorized users to interact with z/OSMF and OMEGAMON APIs.
The following table shows which models support each deployment type.
Model Deployment type supported
granite-4.1-8b-instruct s390x
llama-3-3-70b-instruct x86
Note: As watsonx Assistant for Z is powered by IBM watsonx Orchestrate®, this documentation includes descriptions that refer to this underlying technology.