Prerequisites
Hardware Requirements
- Spyre Cards: Spyre cards must be physically attached, discoverable by the OS, and explicitly activated.
- Operating System: Red Hat Enterprise Linux (RHEL) v9.6 or higher.
- Container Engine: AI Services uses Podman as the container engine. It can be installed by running -
ai-services bootstrap configure- in your LPAR.
- User Privileges: root access is required.
- Connectivity: Active internet connection is required.
Note: To register the system with Red Hat Enterprise Linux after obtaining the subscription, follow Registering the system and managing subscriptions .
Log into RH registry
AI Services uses Virtual Large Language Model (vLLM) to work with Spyre. Make sure to log into the Redhat Registry to fetch assets when creating applications.
podman login registry.redhat.io