The IBM AI Platform
IBM Generative AI Reference Architectures
A recolored leadspace using the Watson for Customer Care leadspace as its basis.

IBM's AI platform provides a comprehensive suite of tools that addresses the capabilities in the enterprise capability model. This section walks through the capability to product mapping shown below; documenting how the IBM platform realize the suite of capabilities in a generative AI architecture.

Generative AI Architectures

review generative AI architectures on the Hybrid Cloud Architecture Center

Products, Capability Groups, and Capabilities

This section documents how the IBM AI product portfolio aligns to the capability groups within the the enterprise model per capability group.

IBM provides the full set of capabilities in the Model Hub capability group. is available as both a cloud-based service and as an on-premise deployment package; enabling a hybrid deployment approach that combines on-premise and cloud-based capabilities; providing architects with the flexibility they need too meet the functional and non-functional requirements of their generative AI solutions without having to make substantial architectural trade-offs.

IBM provides the Model Lifecycle Management, Model Inferencing, and Model Access Policy Management capabilities of the Model Hosting capability group. For Model Inferencing, provides enterprises with the ability to deploy generative AI models as REST services using a common API. This makes it easy for generative AI solution developers to incorporate and access models within their applications, while also enabling data scientists and AI engineers to update models over time without impacting the consuming applications. offers deployment spaces to address Model Access Policy Management capabilities. Deployment spaces are access controlled collections of deployable models, data, and environments that enterprises can use to manage their generative AI models and control access to those assets.

For Model Lifecycle Management, gives enterprises the ability to deploy, update, and retire / delete models over time.

IBM provides the Model Fine-tuning and Embeddings Generation capabilities within the Model Customization group. Model Tuning is supported by a companion solution, Red Hat Openshift AI.

BM watsonx.governance provides the majority of the capabilities in the Model and Data Governance group. Specifically, watsonx.governance provides Model and Data Card Management, Model Catalogue Management, Model Risk Governance, and Legal and Compliance Management. Data Catalog Management is provided by IBM

Model monitoring is the operational aspect of Model and Data Governance, and so IBM watsonx.governance provides many of the capabilities with the Model Monitoring group to complement the Model and Data Governance capabilities it provides. Specifically, watsonx.governance provides the HAP Detection, Model Drift Detection, Model Feedback and Improvement, Explainability, and Model Evaluation capabilities within this group.

IBM provides the Prompt Engineering and Prompt Tuning capabilities within the GenAI Engineering group. Model Tuning is supported by a companion solution, Red Hat Openshift AI.

IBM watsonx Orchestrate uses natural language processing to draw from a catalog of basic and advanced skills to execute on your requests—in context and in the right order.

watsonx Assistant conversational AI for fast and friendly customer care watsonx Code Assistant enables developers of all experience levels to write code with AI-generated recommendations.
Next steps

Talk to our experts about implementing a hybrid cloud deployment pattern.

More ways to explore Hybrid Cloud Architecture Center Diagram tools and templates IBM Well-Architected Framework

Mihai Criveti, Wissam DibChris Kirby

Updated: December 5, 2023