AI Optimizer for Z and LinuxONE runs as a container-based appliance on a IBM Z or IBM LinuxONE system. To get started, you first use the Hardware Management Console (HMC) to configure the Secure Service Container (SSC) LPAR that will host the appliance. After the LPAR is prepared, you use the AI Optimizer for Z and LinuxONE Appliance Manager UI to install the product image for the appliance, deploy all the required components, and complete one-time configuration.
Before you begin
Before you start the installation process, ensure that you have the following required hardware,
authorization, and product materials in place. If you encounter issues during installation, see Troubleshooting problems in AI Optimizer for IBM Z and IBM LinuxONE for troubleshooting guidance.
- Verify that you have allocated and defined a dedicated SSC LPAR with the required system capacity, installed
all the prerequisite software, and attached the required Spyre accelerator cards as described in Preparing for AI Optimizer for IBM Z and IBM LinuxONE installation.
- Obtain administrative access to the HMC
for the IBM Z or LinuxONE system where the allocated LPAR is. You will
need to use the access for configuring the SSC LPAR and preparing it for AI Optimizer for Z and LinuxONE
installation.
- Obtain the AI Optimizer for Z and LinuxONE installation image file
from IBM. The image contains all the
required components of the appliance.
- Obtain your IBM Entitlement Key from the
IBM Container Library. The key is required
to access container images for AI Optimizer for Z and LinuxONE core
services and LLM models.
- Determine the container registry type that you will use for your deployment (IBM Container Registry for environments with internet
connectivity, or a custom registry for air-gapped or restricted environments).
- If you plan to use a custom registry, ensure that you have completed the image mirroring process
described in Mirroring container images to a custom registry before starting the installation.
About this task
This procedure describes the HMC-based installation method. For an overview of the installation architecture, available installation methods, and complete workflow, see Understanding AI Optimizer for IBM Z and IBM LinuxONE installation.
AI Optimizer for Z and LinuxONE supports three installation methods:
- HMC (described in this procedure)
- Appliance Control Center for IBM Z and LinuxONE (ACC) UI
- ACC Ansible Playbooks
Regardless of the installation method you choose, the final configuration steps (configuring
the container registry and initializing components) are common to all methods.
Procedure
- Access the Hardware Management Console to begin the installation process.
From your workstation, log in to the HMC with the administrative credentials that you have
obtained.
- Set up the SSC LPAR in
installer mode to prepare for image installation.
In the HMC interface, create a new
SSC LPAR and run it in the installer mode.
This mode creates an isolated, secure SSC
environment on the LPAR to receive and process the AI Optimizer for Z and LinuxONE appliance image. The web-based interface of the
installer mode will guide you through the installation process.
- Create an administrative user of the AI Optimizer for Z and LinuxONE appliance.
When prompted, specify a username and password to create an administrator account for AI Optimizer for Z and LinuxONE. For the username, use alphanumeric characters (letters and numbers) only. Do not include any special characters.
Take note of the username and password. You will need to use them to install, configure, and manage the appliance. For example, you will need the credentials to log in to the AI Optimizer for Z and LinuxONE Appliance Manager to configure and manage the appliance.
- Access the installer interface through your web browser.
In your web browser, open the SSC LPAR
web interface by entering its IP address.
Important: The installer interface requires encrypted connections. Always use the
HTTPS protocol when opening the interface in your browser (for example,
https://<ssc-lpar-ip>). If you omit the HTTPS protocol or use
the HTTP protocol, your connection attempt will be automatically rejected.
- Upload the AI Optimizer for Z and LinuxONE appliance image to the installer.
Browse for or navigate to where you store the AI Optimizer for Z and LinuxONE image. Select the image file and upload it to the installer.
- Verify that sufficient storage is available for the installation.
The installer will check for available disk space on the SSC LPAR.
Important: The system requires more than 100 GB of available disk space to install and
configure AI Optimizer for Z and LinuxONE. If the available disk space
is insufficient, the installer will display an error message. You must allocate the required storage
before continuing.
- Start the image installation process.
The installer will extract, copy, and load the image contents onto the SSC LPAR, including all the components of the appliance, the required operating system, and the runtime environment.
The installation process may take a few moments to complete, depending on your system's performance and network speed. The installer will display progress indicators and show the current status.
- Access the AI Optimizer for Z and LinuxONE Appliance Manager UI to begin configuration.
After the installation completes and the appliance is ready for configuration, the installer will
automatically redirect you to the
Appliance Manager UI.
- If the redirect does not work, navigate to the UI by entering
https://<ssc-lpar-ip>/config in
your browser.
Enter the administrative user credentials that you created in Step 3 to log in.
Take note of the URL. You will need to use it to access and manage Users, Logs, and Dumps through the Appliance Manager UI.
- Configure the container registry to enable access to component images.
On the
Appliance administration
page, configure the container registry to
access AI Optimizer for Z and LinuxONE component images.
- Click Configure to open the
Configure container
registry
dialog.
- Select a registry type:
- IBM Container Registry (for environments with internet
connectivity).
- Custom registry (for air-gapped or restricted environments).
- If you selected IBM Container Registry, enter your IBM Entitlement Key in the provided
field.
- If you selected Custom registry, provide the following
information:
- Enter the registry URL (for example, registry.example.com).
- Select the authentication method: Username and password or
Access token.
- Enter the required credentials based on your selected authentication method.
- Optionally configure proxy settings if your registry requires proxy
access.
Enable proxy and specify one of the following settings:
- HTTP proxy (for example,
http://proxy.example.com:8080)
- HTTPS proxy (for example,
http://proxy.example.com:8443)
- No proxy (comma-separated list such as
localhost,127.0.0.1,.example.com)
- Click Save to apply the registry configuration.
- Start and monitor the initialization of all system components.
On the Appliance administration
page, start the AI Optimizer for Z and LinuxONE stack initialization.
After configuring the container registry, the system begins initializing all required components.
The components are listed under Component with their current status. Monitor the
status indicators as each component initializes.
The initialization process of a component completes successfully when its status changes to
Running preceded by a green checked mark. The green status indicates that the
component is up and running correctly as expected. Do not proceed until all components show a green
status.
When the status of all components turns green, Inference router is
enabled. This indicates that the AI Optimizer for Z and LinuxONE
Appliance Manager and the inference router are
successfully configured and fully operational.
- Verify that the installation completed successfully.
On the Appliance administration
page, verify the appliance
installation and configuration by launching the AI Optimizer for Z and LinuxONE UI.
Click Inference router to open the AI Optimizer for Z and LinuxONE UI. Enter the same administrative user
credentials that you created in Step 3 to log in. Optionally, you can
launch the UI directly in your browser by going to https://<ssc-lpar-ip>.
Successful login will launch the Inference router page of the UI, which indicates
that the UI is ready for use.
What to do next
After completing the installation and verification, deploy LLMs to begin using AI Optimizer for Z and LinuxONE for AI inference. See Deploying or undeploying LLMs in AI Optimizer for IBM Z and IBM LinuxONE.
For ongoing management and troubleshooting: