This blog is for the open exchange of ideas relating to IBM Systems, storage and storage networking hardware, software and services.
(Short URL for this blog: ibm.co/Pearson )
Tony Pearson is a Master Inventor, Senior IT Architect and Event Content Manager for [IBM Systems for IBM Systems Technical University] events. With over 30 years with IBM Systems, Tony is frequent traveler, speaking to clients at events throughout the world.
Lloyd Dean is an IBM Senior Certified Executive IT Architect in Infrastructure Architecture. Lloyd has held numerous senior technical roles at IBM during his 19 plus years at IBM. Lloyd most recently has been leading efforts across the Communication/CSI Market as a senior Storage Solution Architect/CTS covering the Kansas City territory. In prior years Lloyd supported the industry accounts as a Storage Solution architect and prior to that as a Storage Software Solutions specialist during his time in the ATS organization.
Lloyd currently supports North America storage sales teams in his Storage Software Solution Architecture SME role in the Washington Systems Center team. His current focus is with IBM Cloud Private and he will be delivering and supporting sessions at Think2019, and Storage Technical University on the Value of IBM storage in this high value IBM solution a part of the IBM Cloud strategy. Lloyd maintains a Subject Matter Expert status across the IBM Spectrum Storage Software solutions. You can follow Lloyd on Twitter @ldean0558 and LinkedIn Lloyd Dean.
Tony Pearson's books are available on Lulu.com! Order your copies today!
Safe Harbor Statement: The information on IBM products is intended to outline IBM's general product direction and it should not be relied on in making a purchasing decision. The information on the new products is for informational purposes only and may not be incorporated into any contract. The information on IBM products is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. The development, release, and timing of any features or functionality described for IBM products remains at IBM's sole discretion.
Tony Pearson is a an active participant in local, regional, and industry-specific interests, and does not receive any special payments to mention them on this blog.
Tony Pearson receives part of the revenue proceeds from sales of books he has authored listed in the side panel.
Tony Pearson is not a medical doctor, and this blog does not reference any IBM product or service that is intended for use in the diagnosis, treatment, cure, prevention or monitoring of a disease or medical condition, unless otherwise specified on individual posts.
The developerWorks Connections Platform is now in read-only mode and content is only available for viewing. No new wiki pages, posts, or messages may be added. Please see our FAQ for more information. The developerWorks Connections platform will officially shut down on March 31, 2020 and content will no longer be available. More details available on our FAQ. (Read in Japanese.)
Last week, I presented at the "IBM TechU Comes to You" event in beautiful Nairobi, Kenya. This was a three-day event, so here is my recap of Day 3, Thursday Aug 4, 2016.
Business Continuity and Disaster Recovery for z Systems
I have been working in Business Continuity and Disaster Recovery my entire career at IBM, so when I was asked to give a "z Systems" mainframe slant to my standard BC/DR pitch, I was up to the challenge. IBM offers a complete set of solutions, and I presented best practices for each.
Data Protection, Management and Journey to the Cloud with IBM Spectrum Protect
This session was presented by Saumil Shah, IBM Spectrum Protect Sales Leader for Middle East, Turkey & Africa. I am glad that Saumil volunteered to cover IBM Spectrum Protect, as I already had six sessions on my plate for this week. My version tends to focus on the "What and How" of data protection, whereas Saumil focused instead on the "Why" of data protection. Why should you protect data, and why you should use IBM Spectrum Protect instead of the various other software out in the marketplace.
IBM Spectrum Virtualize - Understanding SVC, Storwize and the FlashSystem V9000
IBM Spectrum Virtualize is the new name for the code base shared by all of these products. I presented the latest features of SVC, Storwize and FlashSystem V9000 hardware models, as well as the latest software features.
How to combine the advantages of Storage Virtualization and Flash performance (the Turbocompression effect)
This session was presented by Dominique Salomon, IBM Certified IT Specialist Storage and European New Technology Introduction Leader. He works at the IBM Montpelier Briefing Center in France, a sister organization to the IBM Tucson Executive Briefing Center that I work in. The term "Turbocompression" was initially coined by his team in Montpelier to explain the combined benefits of Flash technology, Easy Tier automated sub-LUN tiering, with Real-time Compression.
I have to admit that the first time I heard this, I was skeptical. It sounded like a marketing gimmick to mention these together. However, once I saw the demo and the resulting numbers, I was convinced. IBM Easy Tier technology identifies and ranks which blocks are the busiest, and moves extents to the appropriate place. Real-time Compression can compress data in cache memory, flash and spinning disk, allowing more of the busiest blocks of data to reside in the fastest storage media. This means higher hit ratios for cache, lower latency for flash, and less wear-and-tear on the spinning disk drives.
Storage Integration with OpenStack
While OpenStack is used by more than 60 percent of Cloud Service providers, it is used by fewer than 10 percent of the Fortune 500 corporations. This represents an excellent opportunity for IBM, leading in having its storage products support this important open source interface.
IBM supports OpenStack Cinder interface for its block level devices, including DS8000 and XIV. IBM Supports OpenStack Swift for its object storage, including IBM Spectrum Scale, IBM Spectrum Archive, and IBM Cloud Object Storage System (formerly Cleversafe). IBM Spectrum Scale supports OpenStack Cinder, Swift, and Manila interfaces for a complete solution across volumes, files and objects.
Marlin Maddy, IBM Manager of Worldwide Systems Technical Events, served as master of ceremonies. He thanked the audience for attending, and drew names for prizes. This time these were Samsung "smart-watches".
Thursday evening, some people left, and the few of us remaining had dinner at the Intercontinental Hotel. I joined folks from USA, Germany and Middle East. I love our informal discussions! I learn so much listening to other points of view.
Last week, I presented at the "IBM TechU Comes to You" event in beautiful Nairobi, Kenya. This was a three-day event, so here is my recap of Day 2, Wednesday Aug 3, 2016.
IBM Spectrum Scale overview and update
This session was covered by Mack Kigada, IBM Executive Consultant for the "Executive Advisory Practice" portion of Systems Lab Services. This session explained the basic features of Spectrum Scale, including the latest features of version 4.2, and related Elastic Storage Server pre-built systems.
Software Defined Storage - IBM Spectrum Overview
This session was presented by Saumil Shah, IBM Spectrum Protect Sales Leader for Middle East, Turkey & Africa. Since SDS is an important topic, the conference coordinators schedule several speakers to present at different time slots, to give everyone a chance to hear the SDS message. Rather than using my same charts, Saumil used his own deck, which he customized based on his experience working in this region.
Flash and the Next Generation Data Center
This session was covered by Firat Ozturk, IBM FlashSystem Sales Leader for Middle East, Turkey & Africa. While IBM offers all-flash array versions of its DS8000, SVC and Storwize product lines, Firat focused on the IBM FlashSystem family, including the FlashSystem 900, FlashSystem V9000, and the new A9000/A9000R models.
According to IDC, Flash-based technologies are predicted to represent 50 percent of the storage capacity sold in 2018. Today it is about 10 percent, so that is a big leap. The primary reason he feels are new applications like Cloud and Mobile that are driving customer expectations to faster performance.
Which product should you get? Firat indicated that the FlashSystem 900 is ideal to boost the performance of specific applications, like Oracle or SAP HANA. The FlashSystem V9000 borrows all the code base from SVC and Storwize with Real-time compression ideal for OLTP and Database applications, while offering Storage Virtualization to protect your existing storage infrastructure investment. The FlashSystem A9000 and A9000R are targeted to Cloud deployments, as well as Server Virtualization and Virtual Desktop Infrastructure (VDI).
What is Big Data? Architectures and Practical Use Cases
I have been presenting this since 2013, but still draws a new crowd every time. Based on my [2015 Presentation], I made some updates to reflect IBM's latest support for Spark, and the new POWER8 solution offerings.
Storage Tiering on z Systems: Less Management, Lower Costs, Less Management, and Increased Performance
When I present Storage Tiering for distributed systems, I typically focus on Easy Tier feature of SAN Volume Controller, the Analytics-based storage optimization of Spectrum Control, and the Information Lifecycle Management (ILM) policies of Spectrum Scale and Spectrum Archive. This time, Glenn Anderson asked me to give this a "z Systems" slant, for a mainframe-oriented audience.
In this new version, I focused on Easy Tier on IBM DS8000 systems, Hierarchical Storage Management in DFSMShsm, and the new Class Transition features that were introduced initially with DFSMSoam for objects, and now extended for data sets.
Linux on IBM z Systems and its Participation in Open Source Ecosystem, including Blockchain
Wow! What a long title!
This session was presented by Holger Smolinski, IBM Senior Performance Analyst Linux and KVM on IBM z Systems from the Boeblingen, Germany Lab. Back in the late 1990s, Holger and I worked on porting Linux to the S/390 platform. I led a team to test all of the device drivers for IBM disk and tape storage systems, working with Holger and his team to fix the drivers and submit them to the Open Source Community, so that they would be incorporated formally into the latest Red Hat and SUSE distributions.
Holger gave quite an extensive overview of the entire Open Source Ecosystem that run on Linux on z System mainframes. Over 60 percent of new mainframe customers use Linux on z Systems operating system, and the complete set of capabilities, makes this quite practical.
One of the latest of these is [Blockchain], a new way to track transactions between organizations. The open source project for this is [HyperLedger]. Transactions are recorded into blocks that are encrypted with a hash code, which prevents tampering and fraud. These blocks are then chained together as transactions occur between organizations.
For example, if a product is manufactured in China, shipped over the Pacific Ocean by a shipping company, received at a port in the United States, processed by US Customs, then shipped via trucking company to the buyer, these all would be represented as transaction blocks chained together.
Wednesday we had free evening to explore on our own. Some of my colleagues went to an all-you-can eat steakhouse for dinner, but I will get plenty of that in my upcoming trip to Sao Paulo, Brazil, so went elsewhere.
Last week, I presented at the "IBM TechU Comes to You" event in beautiful Nairobi, Kenya. This was a three-day event, so here is my recap of Day 1, Tuesday Aug 2, 2016.
Opening Keynote Session
Once again, Marlin Maddy, IBM Manager of Worldwide Systems Technical Events, served as master of ceremonies. He arrived into Nairobi just a few hours earlier, and we were worried that one of us might have to jump in and take over if he had any delays in his flight schedule. Fortunately, he arrived and did a great job welcoming the audience.
Eric Jaoko, chief manager of Kenya's Rural Electrification Agency [REA], presented next. Back in 1973, the Kenyan government wanted to have all of its rural areas offering electrical service. Some 30 years later, in 2002, only 4 percent of the rural areas had achieved this. In 2006, the Kenyan government formed this new REA agency to accelerate the progress. By 2008, nearly 25 percent of rural areas were electrified. Currently (2016), they are now at 68 percent, including all primary schools (more than 20,000 across the country).
Eric mentioned that this success was in part to their partnership with IBM for Information Technology. REA switched from Oracle to SAP applications on IBM Power systems with IBM Storwize V7000, resulting in lower costs, less power consumption, easier to deploy and manage, redundancy and high availability, scalability and high speed access to critical data. Not surprisingly, IBM's leadership in "Mobility" plays another key role, since these areas are rural and often connected only by cellular phone service.
REA employees both AIX and Linux on POWER operating systems, and uses OpenStack to manage both the servers and storage components. PowerVM, PowerVC and PowerHA complete the solution to provide a more robust environment. REA found it was very easy to clone their SAP systems, which made it very easy to test software upgrades without impacting their production environments.
The next speaker was IBM's own Glenn Anderson, IBM z Systems Consultant and Worldwide Technical Events Content Manager. His talk was titled "Think Outside the Cubicle" to emphasize that there are changes underfoot in the IT industry. Rather than focusing on IT as a cost to be reduced, enlightened CEOs are discovering that IT can be used to optimize value for their organization.
One trend that has changed drastically is what IBM refers to as "Systems of Engagement". To better connect with clients, customers and suppliers, organizations now create conversations on social media channels, listen and react to those conversations, building communities that allow them to better understand and serve their markets.
Another trend was "Two-speed IT", often called "Bimodal IT", which indicates that some projects should have "fast-track" status, streamlining the process of design, development and deployment for new innovations. This is in contrast to traditional "slower" projects for mission critical "Systems of Record" operations, like databases and Online Transaction Processing (OLTP).
His last trend he covered was this notion of "Cognitive Business", the use of self-learning, natural language processing to assist in business decision making. Glenn compared the old way as a static map that indicated "You Are Here". The new way was more like GPS, which indicated where you are, where you want to be, and the steps to get there.
(You might ask "Why do business leaders need such assistance?" First, business executives cannot ingest and comprehend the vast amount of data they need to make correct decisions, causing them to make less-than-optimal choices with limited information. Second, business leaders are often only on the job a few years, moving around from one opportunity to another, and do not build the experience background that a computer that can ingest millions of documents can achieve much more quickly. Third, business leaders often are prone to bias, surrounding themselves with ["yes-men"], unwilling to accept any information that contradicts their world view. Computers do not have that bias, and are capable in finding insights, trends and patterns that business leaders might not have considered.)
Software Defined Storage -- What? Why? How?
I was honored to be asked to be the keynote kick-off for the IBM Storage track of this conference. There is still much confusion over the concept of Software Defined Storage (SDS). While there are many different positions on this, IBM has adopted the IDC definition, which requires all three criteria to be met:
Solutions based on Industry-standard, off-the-shelf components.
Solutions that offer the complete set of storage features and functions, such as point-in-time copies, data footprint reduction, technical refresh migration, and remote replication.
Solutions that are offered in multiple ways, such as software-only, pre-built systems using industry-standard off-the-shelf components, and cloud-based services.
IBM's SDS offerings include all of the IBM Spectrum Storage family available as software-only, pre-built systems like SAN Volume Controller and XIV Gen3, and cloud-based services like IBM Cloud Managed Backup and Archive, and IBM Cloud Object Storage System (formerly Cleversafe).
IBM ranks #1 in SDS marketplace, with over 40 percent marketshare. The advantage of IBM's approach is that it does not require a complete rip-and-replace of existing IT infrastructure. IBM solutions can work with your existing servers and storage that you have already in place! This allows for a smooth and graceful transition.
Cloud Computing Concepts and the Role of Infrastructure
This session was covered by Mack Kigada, IBM Executive Consultant for the "Executive Advisory Practice" portion of Systems Lab Services. Frankly, I think this should have been classified as a "Cross-Brand" rather than other "Storage", as it showed not just storage but also how servers and OpenStack participate in a complete Hybrid Cloud solution.
The new IBM FlashSystem A9000 GUI
This session was presented by Dominique Salomon, IBM Certified IT Specialist Storage and European New Technology Introduction Leader. He works at the IBM Montpelier Briefing Center in France, a sister organization to the IBM Tucson Executive Briefing Center that I work in.
When IBM was ready to launch its newest FlashSystem offering, which combines the low-latency IBM FlashCore technology from IBM FlashSystem 900 with the IBM Spectrum Accelerate software from XIV, they had to decide what Graphical User Interface [GUI] to deploy it with. The IBM development team had narrowed it down to three options:
Use the IBM XIV Gen3 GUI, which is installed client code that runs on a handful of select operating systems. This GUI is nine years old.
Adopt and modify the browser-based GUI used by all of the other IBM Storage systems like DS8000 and SAN Volume Controller. By using HTML5, AJAX and Dojo widgets, this newer approach eliminates Operating System and Java dependencies, and can run on desktops, laptops, tablets and smartphones. However, this technology is four years old.
Deploy a new GUI, adopting the latest techniques and methods, offering a new, simpler way to manage the new device.
The development team decided on the third option, and so Dominique spent the first half hour explaining what the IBM FlashSystem A9000 and A9000R systems are, and then the last half showing a live demo connecting back to his systems in Montpelier, France.
IBM XIV, Spectrum Accelerate and the new IBM FlashSystem A9000
This session was covered by Maurice "Mo" McCullough, IBM Storage Technical Content Leader for IBM Systems Worldwide Technical Events. In retrospect, he admitted that he should have scheduled this session before Dominique's session above, which would have reduced the amount of time and questions Dominique spent explaining the IBM FlashSystem A9000 and more time showing the new GUI.
Mo first covered the newest model of the XIV Gen3 pre-built system, the model 314. It has double the cache memory and double the processing cores to drastically improve Real-time compression. Then, he explained IBM Spectrum Accelerate, available as either software you can deploy on your own x86 servers on-premises, or in cloud-based servers from IBM SoftLayer. Finally, Mo covered the A9000 and A9000R, the newest members of the IBM FlashSystem family that share features and capabilities with the XIV Gen3 and Spectrum Accelerate offerings.
Tuesday evening we had a welcome reception for all the attendees, staff and speakers. This was a great time to relax and meet everyone on a social level.
Well, it's Tuesday again, and you know what that means? IBM Announcements!
New Nearline expansion enclosures for FlashSystem V9000 and SAN Volume Controller (SVC)
The new 12 Gb SAS expansion enclosure expands total capacity and delivers a tiered data solution. Each LFF expansion enclosure supports twelve 3.5-inch 8 TB NL-SAS drives. Up to two expansion enclosures are supported by a FlashSystem V9000 or SVC controller pair, delivering up to twenty-four drives and 192 TB of raw capacity. The capacity can be compressed up to 5x (80 percent savings) using IBM Real-time Compression.
IBM Spectrum Control and IBM Virtual Storage Center V5.2.10 release
IBM Spectrum Control continues its quarterly continous delivery model with version 5.2.10 release. This is also included in all variants of IBM Virtual Storage Center which bundles IBM Spectrum Control with IBM Spectrum Virtualize products. New features include:
View more details about capacity growth over time for storage systems, pools, volumes, fileset, and file systems. This helps capacity planners to plan for future purchases and procurement.
Aggregate basic information across multiple Spectrum Control servers into a single place, rolling up information was temporally removed in Spectrum Control V5.2.8 and is now available in the web-based GUI for the first time. This is intended for clients to manage multiple data center sites, but can also be used to Cloud Service Providers and Managed Service Providers to generate reporting across a group of clients.
Compare the workload and performance characteristics of IBM SAN Volume Control and IBM Storwize systems against best practice performance guidelines. This is especially useful synergy for the IBM Virtual Storage Center bundles.
Export performance data for storage systems and fabrics using a new Create Performance Support Package wizard. This is helpful in case you observe a performance problem with your IBM storage system, and the IBM support for that device would like to receive the measured performance statistics for further analysis. In the same manner that IBM Spectrum Control drastically reduces troubleshooting time for clients, it is also proven useful for IBM support teams.
Understand how the capacity of storage systems is used when storage virtualization is implemented in the environment, by looking at the information about virtualized and non-virtualized capacity. This allows storage administrators to show upper management how their investment in IBM Spectrum Virtualize (SVC, Storwize, etc.) has returned on investment.
Launch the IBM Spectrum Scale GUI from IBM Spectrum Control to deliver an even better integration of the two products.
It is hard to believe I was the "Technical Evangelist" for SAN Volume Controller when it launched in 2003. That was 13 years ago! Since then, a variety of products using the shared codes base (IBM Spectrum Virtualize) have launched, including IBM Storwize family and IBM FlashSystem V9000 mentioned above. The new IBM Spectrum Virtualize Software V7.7 delivers the following improvements:
Reliability, availability, and serviceablility with NPIV host port fabric virtualization. This is actually pretty cool feature. NPIV stands for "N-port ID Virtualization". Every Spectrum Virtualize port has an N-port ID, and if one node fails, multi-pathing software must scramble to look up its partner node and re-direct traffic to the ports of that other node. With NPIV, the partner node takes on the N-ports of both its own node, as well as the failed node, and handles all the traffic, and then gives back the N-ports back to the other node when it is back up and running.
Distributed RAID (DRAID) support for encryption. IBM added support for distributed RAID-5 and RAID-6 in the previous release, but at the time did not include the built-in encryption feature for these new kind of RAID ranks. Now it supports encryption.
Graphical User Interface (GUI) enhancements to manage your IP-based quorums. Previously, if you had a two-site configuration like Stretched Cluster or HyperSwap, best practices would require a third location as "tie breaker". Thus, people ran fiber optic cables from both sites to a third location, with a small disk system in a closet somewhere. The IP-based quorum is a little Java program you can run on any system, and so long as both sites have LAN or WAN access, serves the same role.
Graphical User Interface (GUI) enhancements to run the "Compresitmator" tool. The Comprestimator tool can run against existing volumes (vDisks) to identify estimated compression savings.
Flexibility Virtualization of iSCSI-attached and Fibre Channel-attached external Storage arrays. Previously, only Fibre Channel (FCP and FCoE) back-end devices could be virtualized. Initially, this will support iSCSI virtualization of IBM Storwize and Dell EqualLogic.
Performance with 64 GB read cache. The software code was enhanced to take advantage of 64-bit memory addressing to support larger read cache.
Software licensing metrics to better align the value of SVC software with Storage use cases through Differential Licensing, based on Storage Capacity Unit (SCU). The licensing for SVC has base and compression license based on the back-end (managed physical usable capacity), and then various features that are based on the subset of front-end capacity (virtual volumes). The new Differential Licensing applies SCU to the back-end (base license and compression). The front-end features continue to be TB-based.
IP Link compression to improve usage of IP networks for remote-copy data transmission
Differential Licensing based on Storage Capacity Unit (SCU)
Differential licensing based on new concept IBM calls Storage Capacity Unit (SCU). Previously, software was licensed per Terabyte (TB), but that treated all TB the same, from Flash to Nearline disks. The new license method takes storage media into three categeories:
1 SCU equals 1.00 TB of Flash and Solid-State Drives (SSDs), and any other storage not listed in the categories below.
1 SCU equals 1.18 TB of 10K and 15K rpm drives, such as Serial Attached SCSI (SAS) Drives and Fiber Channel Drives, as well as systems using "Category 3" (Nearline or SATA drives) with advanced architectures to deliver high-end storage performance, such as IBM XIV Storage System, HP 3PAR or Infinidat .
1 SCU equals 4.00 TB of 7200 rpm Nearline SAS (NL-SAS) and Serial ATA (SATA) Drives
This new licensing is experimental. I would be interested in your feedback.
Well, it's Tuesday again, and you know what that means? IBM Announcements!
Last week, IBM announced a variety of tape system enhancements.
IBM TS7760 Virtual Tape System
The IBM TS7760 combines the benefits of the previous TS7720 and TS7740 offerings. Those with IBM z System mainframes will recognize both. The TS7740 has a small amount of disk that pretend to be a tape library, with enough capacity to hold a few hours to a few days worth of data. After that, the data is moved to physical tape. The TS7720 is an all-disk solution, holding up to 1 PB of disk to hold weeks or months worth of data, but did not have tape attachment. Previously, IBM announced the TS7720T, a high-capacity offering with tape attachment. The new TS7760 is now the replacement for all three of these, powered by the latest POWER8 processor.
In addition to all the features available in the former models, the new TS7760 uses 4TB drives instead of 3TB drives, resulting in a maximum capacity of 1.3PB of disk capacity before compression. The disks are encrypted and protected by distributed RAID-6 referred to as "Dynamic Disk Pooling". While tape attachment is still optional, it supports both IBM TS3500 and TS4500 tape libraries.