AMD Instinct MI300X GPU on IBM Cloud

Designed to deliver leadership performance for Generative AI workloads and HPC applications

Close-up of a AMD Instinct MI300X being built
The AMD Instinct MI300X GPU offers 192 GB of HBM3 memory

This powerful GPU is enabling leadership performance for the data center, at any scale. These GPUs are uniquely well suited to power even the most demanding AI and HPC workloads, offering exceptional compute performance, large memory density, high-bandwidth memory and support for specialized data formats.

Benefits
Graphics and charts displayed on a clean background illustration
Lower TCO at scale

192 GB of HBM3 memory provides cost-effective generative AI performance for more or larger AI models at scale, so fewer GPUs are needed.

A cloud icon representing documents, processes integrated illustration
High AI and HPC performance

The GPU is optimized for matrix and tensor operations with FP8, FP16, BF16 and INT8 precision, balancing performance and accuracy.

Application displaying a variety of colors in different sections and features illustration
Open development

AMD-ROCm open software includes a broad set of programming models, tools, compilers, libraries and runtimes. By supporting APIs deployed by industry leaders, developers can easily port development code.

Deplyoment
AMD Instinct MI300X OAM Card Face
The MI300X instance on IBM Cloud

The instance on IBM Cloud comes with the following specifications

  • 208 vCPUs
  • 1792 GB RAM
  • 8 x 3.2 TB instance storage
  • 8 x AMD Instinct MI300X GPU

 

This offering is currently under select availability. Please create a support case if you are interested in purchasing and using AMD MI300X on IBM Cloud.

 



Resources
Abstract illustration of a globe made of geometric shapes icons
IBM watsonx.ai demo
Take a tour of the watsonx.ai® developer studio. Build prompts, experiment with foundation models and create ML models.
Watch this short video on Red Hat OpenShift AI on IBM Cloud.
A blue and white Pattern made with circles and lines
IBM Cloud VPC docs
Learn more about IBM Cloud Virtual Private Cloud. Explore provisioning guides, tutorials and more.
Related products
Watsonx with sub-brand logo
IBM watsonx
Explore a full portfolio of AI products that accelerate the impact of generative AI in core workflows to drive productivity.
An illustration of a developer working on a laptop using hybrid cloud technologies
Red Hat AI on IBM Cloud
Bring mission-critical AI applications and initiatives to market with Red Hat AI InstructLab™, Red Hat OpenShift AI and Red Hat Enterprise Linux® AI.
Team of Two Creative Entrepreneurs Discussing Growth Strategy While Looking at a Laptop.
IBM Cloud Kubernetes Service
Choose a certified, managed Kubernetes solution built for creating a cluster of compute hosts to deploy containerized apps on IBM Cloud. IBM manages the primary instance, freeing you from host OS, runtime and version-update processes.
Professional IT Programer Working in Data Center on Desktop Computer with Three Displays.
Deployable architectures on IBM Cloud
Accelerate innovation, enhance efficiency and maintain security and compliance while optimizing costs.
A numbered flow chart labeled with icons, numbers and geometric shapes
Retrieval augmented generation (RAG) pattern on IBM Cloud
Automate RAG deployment with supporting IBM Cloud and watsonx services and embed your enterprise data in generative AI solutions.
Empty corridor in a server room
IBM Cloud Virtual Servers for VPC
Use highly scalable, single-tenant and multitenant virtual machines that you can start quickly for maximum network isolation and control.
Get started

Explore AMD MI300X GPU Instances on IBM Cloud.

 

Explore documentation