Storage

Elastic Storage Server: Networking is what it’s all about!

Share this post:

I was recently in a training session about IBM Elastic Storage Server (ESS)—a high-performance IBM Spectrum Scale storage solution—in which a colleague remarked, “It’s all about the network.”

Why, you might ask, would networking be so essential?

In my previous post about ESS, I focused on the three keys to a successful implementation: pre-planning, network analysis and professional services. I briefly mentioned the significance of network analysis there, but I want to expand on that because networking is probably the most important item to configure for a successful ESS implementation.

Let’s take a look at what the network looks like for both a RedHat Enterprise Linux little endian and big endian implementation.

Network requirements

Within the ESS system, there are three main networks (two non-routable) that Elastic Storage Server requires to operate effectively, and a fourth external connection if connecting into the customer campus network. Of the three networks, the Service Network and the Management/provisioning network are internal to the ESS rack and do not exist on the customer local area network (LAN).

  1. Service network: Each IBM Power Systems server (management and input/output, or I/O, server nodes) has a flexible service processor (FSP), and this network connects them together. If RedHat big endian is installed, the systems are managed by the Hardware Management Console (HMC). If RedHat little endian is used, then this management is accomplished with a second connection on the management server.
  2. Management and provisioning network: This network connects the management server and the I/O server nodes for code provisioning and xCAT management of the cluster. The management server is a Dynamic Host Configuration Protocol (DHCP) server for this network. All the ESS code provisioning happens on this network.
  3. Clustering network: This is a high-speed network, either 10GbE/40GbE or Infiniband. The cluster is created and managed over this network. This network exists within the customer LAN, and is also used to connect Spectrum Scale clients to the ESS storage cluster.
  4. External and campus: The fourth network connects the Executive Management Server (EMS) and HMC (when required) to the client’s public network for management purposes if desired by the organization.

Please refer to the “Appendix B: Networking Requirements for ESS” on page 41 of the Elastic Storage Server Version 5.1 Quick Deployment Guide, found in the IBM Knowledge Center.

The following is a pictorial representation of these networks from the Quick Deployment Guide. The HMC and the Mgmt/Provisioning network are internal to the ESS rack architecture. The 10/40GbE and Infiniband networks are customer networks for the ESS.

Figure 1. The management and provisioning network and the service network: a logical view (on PPC64BE), Elastic Storage Server Network

Figure 1. The management and provisioning network and the service network: a logical view (on PPC64BE)

Figure 2. The management and provisioning network and the service network: a logical view (on PPC64LE), Elastic Storage Server Network

Figure 2. The management and provisioning network and the service network: a logical view (on PPC64LE)

One item to note from these diagrams is that each of these networks are implemented as non-overlapping networks, usually configured as individual virtual local area networks.

So, without getting too technical, what does all of this mean?

Network planning is of the utmost importance in the implementation of an ESS system, which is the main reason that IBM Systems Lab Services spends time helping each client complete a network planning sheet and schedules a meeting to review it with the client. In this pre-implementation network review, we talk about the uses of the system, the clustering network speed the client will use (10G/40G or Infiniband), the host names, IP addresses, domain name services and so on. All of this information is correlated in the spreadsheet, reviewed on a call and then used by the subject matter expert to correctly implement the system for use in the client environment.

Networking matters

Networking is an integral part of the ESS, and, if not planned or set up correctly, it can hinder you from realizing the performance gains that an ESS system can bring into the operation of your mission-critical applications. That is why networking is what it’s all about!

Are you looking for help on a storage and software defined infrastructure project? Reach out to IBM Systems Lab Services today.

More Storage stories

IBM Storage builds on leadership for containers

Cloud object storage, Flash storage, Storage

Next directions to accelerate cloud native Containers are an increasingly important element in the design techniques for enterprises to develop and deliver applications and services with greater speed and agility as part of their cloud-native transformation. IBM Storage has taken a position in enabling the data management and protection of containers with open-source Kubernetes integrations. ...read more


New smart multicloud storage solutions for businesses

Flash storage, Integrated infrastructure, Storage

Today IBM is announcing a broad spectrum of innovations, enhancements and new features across our entire storage portfolio, aimed at providing leading-edge solutions for 21st century business and technology challenges. I hear from business leaders every day about their aspirations as well as their challenges and pain points. They demand the highest levels of performance, ...read more


More for business from IBM Storage

AI, Blockchain, Storage...

Business leaders with enterprises of all sizes have similar aspirations– they want to thrive in a 21st century business environment. To do this, they must leverage the power of technology, including big data and real-time analytics, multicloud architectures, blockchain technologies and certainly artificial intelligence (AI). Take AI for example: The majority of business technology decision-makers ...read more