This blog is for the open exchange of ideas relating to IBM Systems, storage and storage networking hardware, software and services.
(Short URL for this blog: ibm.co/Pearson )
Tony Pearson is a Master Inventor, Senior IT Architect and Event Content Manager for [IBM Systems for IBM Systems Technical University] events. With over 30 years with IBM Systems, Tony is frequent traveler, speaking to clients at events throughout the world.
Lloyd Dean is an IBM Senior Certified Executive IT Architect in Infrastructure Architecture. Lloyd has held numerous senior technical roles at IBM during his 19 plus years at IBM. Lloyd most recently has been leading efforts across the Communication/CSI Market as a senior Storage Solution Architect/CTS covering the Kansas City territory. In prior years Lloyd supported the industry accounts as a Storage Solution architect and prior to that as a Storage Software Solutions specialist during his time in the ATS organization.
Lloyd currently supports North America storage sales teams in his Storage Software Solution Architecture SME role in the Washington Systems Center team. His current focus is with IBM Cloud Private and he will be delivering and supporting sessions at Think2019, and Storage Technical University on the Value of IBM storage in this high value IBM solution a part of the IBM Cloud strategy. Lloyd maintains a Subject Matter Expert status across the IBM Spectrum Storage Software solutions. You can follow Lloyd on Twitter @ldean0558 and LinkedIn Lloyd Dean.
Tony Pearson's books are available on Lulu.com! Order your copies today!
Safe Harbor Statement: The information on IBM products is intended to outline IBM's general product direction and it should not be relied on in making a purchasing decision. The information on the new products is for informational purposes only and may not be incorporated into any contract. The information on IBM products is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. The development, release, and timing of any features or functionality described for IBM products remains at IBM's sole discretion.
Tony Pearson is a an active participant in local, regional, and industry-specific interests, and does not receive any special payments to mention them on this blog.
Tony Pearson receives part of the revenue proceeds from sales of books he has authored listed in the side panel.
Tony Pearson is not a medical doctor, and this blog does not reference any IBM product or service that is intended for use in the diagnosis, treatment, cure, prevention or monitoring of a disease or medical condition, unless otherwise specified on individual posts.
The developerWorks Connections platform will be sunset on December 31, 2019. On January 1, 2020, this blog will no longer be available. More details available on our FAQ.
Well it's Tuesday again, and you know what that means? IBM announcements!
(For those wondering where I went in July, then perhaps the better question should be "where didn't I go?". I started in Boston, MA, then Iceland, England, Hungary, Romania, Qatar, Kenya, Dubai UAE, and finally Seattle, WA. Whew! This week, I am visiting clients in Tennessee.)
Today, IBM launches a whole set of updated offerings based on the IBM Spectrum Virtualize software code base.
IBM Spectrum Virtualize v7.7.1 software-only offering
Like the rest of the IBM Spectrum Storage family of products, IBM Spectrum Virtualize can now be purchased as software only, allowing you to install it on your own x86 servers, rather than purchasing pre-built systems from IBM.
The software license comes in two flavors. The traditional "perpetual license" allows you to move the software from one x86 server to another. Say after 4 years, you have depreciated the server, or the hardware components fail, and you want to get a newer server. This is the same perpetual license that clients with IBM SAN Volume Controller and Storwize family have enjoyed since 2003.
The other is a "monthly license", which allows you to stand up your own "SVC" using your own x86 servers, for a period of months needed for a development/test project, disaster recovery, or some other purpose. After the project is over, you can discontinue the license, and re-purpose the x86 servers for something else. This is especially handy for Managed Service Providers (MSP) and Cloud Service Providers (CSP), but certainly can prove useful in traditional datacenters as well. The "monthly licensing" option is also available for IBM SAN Volume Controller (SVC) as well.
The software license is based on Tebibyte [TiB]. For those not familiar with international standards, here is a comparison table:
The v7.7.1 also provides new features for existing SVC, Storwize and FlashSystem V9000 products. Here are a few:
Manageability with CLI support for host groups
Scalability with support for up to 10,000 virtual disks, depending on the model; and up to 20 Expansion Enclosures on SVC 2145-DH8, Storwize 5639-SV1, FlashSystem V9000 models
RAS and performance enhancements for distributed RAID (DRAID)
Flexibility with iSCSI virtualization support for XIV® Gen 3, Spectrum Accelerate, FlashSystem A9000 and FlashSystem A9000R arrays.
The IBM SAN Volume Controller now offers "Enterprise Class Support" as an option. In the past, the SVC was a "customer setup" box, similar to midrange and entry-level products. Now, you can upgrade your support to match that of IBM DS8000 and XIV enterprise class offerings. This means that IBM experts will maintain your microcode levels for you.
The new 624 model is based on the 10-core [Intel Broadwell] processor, which IBM has clocked at up to 45 percent performance improvement. It also offers up to 128GB of cache memory per system, 64GB per node, double what came standard on the 524 model!
Why "Gen2+"? Moving from an 8-core Haswell to a 10-core Broadwell CPU, and doubling the cache memory didn't seem to be enough "architectural change" to justify calling in a "Gen3", so marketing decided on Gen2+ instead.
I refer to the IBM FlashSystem V9000 as my "Superman" product. When Superman dons on his glasses he becomes "Clark Kent", mild-mannered newspaper reporter. But behind the glasses, he is always Superman! Likewise, the FlashSystem V9000 is an all-flash array with an impressive set of features, but take off the fancy bezel, and you find that it is a pair of fully-loaded SAN Volume Controllers (which we call "Control Enclosures AC3") and a FlashSystem 900 drawer of the world's fastest flash storage.
The FlashSystem V9000 can attach up to 20 expansion enclosures over 12Gb SAS connections. Each expansion enclosure can hold either 24 of the smaller 2.5-inch drives, or 12 of the larger 3.5-inch drives. Of course, the FlashSystem V9000 can also virtualize any of almost 400 other storage arrays, similar to SAN Volume Controller. This provides tiering options that match well with the FlashSystem 900 inside using IBM's Easy Tier auto-tiering capability.
IBM Storwize V7000F and V5030F all-flash array models
The FlashSystem V9000 was originally going to be called the Storwize V9000, but the FlashSystem folks wanted to keep all of the "FlashCore" technology under one name. In perhaps a bit retaliation, or maybe sibling rivalry, the Storwize team added the letter "F" to refer to the All-flash models of the Storwize V7000F and V5030F.
The "flash" in the V7000F and V5030F are just Solid-state drives, not nearly as fast as the cards in the FlashSystem models. The drives come in 1.92TB and 3.84TB capacities. You might see these rounded up to 2TB and 4TB on some presentations, but IBM officially never likes to exaggerate.
Last week, I presented at the "IBM TechU Comes to You" event in beautiful Nairobi, Kenya. This was a three-day event, so here is my recap of Day 3, Thursday Aug 4, 2016.
Business Continuity and Disaster Recovery for z Systems
I have been working in Business Continuity and Disaster Recovery my entire career at IBM, so when I was asked to give a "z Systems" mainframe slant to my standard BC/DR pitch, I was up to the challenge. IBM offers a complete set of solutions, and I presented best practices for each.
Data Protection, Management and Journey to the Cloud with IBM Spectrum Protect
This session was presented by Saumil Shah, IBM Spectrum Protect Sales Leader for Middle East, Turkey & Africa. I am glad that Saumil volunteered to cover IBM Spectrum Protect, as I already had six sessions on my plate for this week. My version tends to focus on the "What and How" of data protection, whereas Saumil focused instead on the "Why" of data protection. Why should you protect data, and why you should use IBM Spectrum Protect instead of the various other software out in the marketplace.
IBM Spectrum Virtualize - Understanding SVC, Storwize and the FlashSystem V9000
IBM Spectrum Virtualize is the new name for the code base shared by all of these products. I presented the latest features of SVC, Storwize and FlashSystem V9000 hardware models, as well as the latest software features.
How to combine the advantages of Storage Virtualization and Flash performance (the Turbocompression effect)
This session was presented by Dominique Salomon, IBM Certified IT Specialist Storage and European New Technology Introduction Leader. He works at the IBM Montpelier Briefing Center in France, a sister organization to the IBM Tucson Executive Briefing Center that I work in. The term "Turbocompression" was initially coined by his team in Montpelier to explain the combined benefits of Flash technology, Easy Tier automated sub-LUN tiering, with Real-time Compression.
I have to admit that the first time I heard this, I was skeptical. It sounded like a marketing gimmick to mention these together. However, once I saw the demo and the resulting numbers, I was convinced. IBM Easy Tier technology identifies and ranks which blocks are the busiest, and moves extents to the appropriate place. Real-time Compression can compress data in cache memory, flash and spinning disk, allowing more of the busiest blocks of data to reside in the fastest storage media. This means higher hit ratios for cache, lower latency for flash, and less wear-and-tear on the spinning disk drives.
Storage Integration with OpenStack
While OpenStack is used by more than 60 percent of Cloud Service providers, it is used by fewer than 10 percent of the Fortune 500 corporations. This represents an excellent opportunity for IBM, leading in having its storage products support this important open source interface.
IBM supports OpenStack Cinder interface for its block level devices, including DS8000 and XIV. IBM Supports OpenStack Swift for its object storage, including IBM Spectrum Scale, IBM Spectrum Archive, and IBM Cloud Object Storage System (formerly Cleversafe). IBM Spectrum Scale supports OpenStack Cinder, Swift, and Manila interfaces for a complete solution across volumes, files and objects.
Marlin Maddy, IBM Manager of Worldwide Systems Technical Events, served as master of ceremonies. He thanked the audience for attending, and drew names for prizes. This time these were Samsung "smart-watches".
Thursday evening, some people left, and the few of us remaining had dinner at the Intercontinental Hotel. I joined folks from USA, Germany and Middle East. I love our informal discussions! I learn so much listening to other points of view.
Last week, I presented at the "IBM TechU Comes to You" event in beautiful Nairobi, Kenya. This was a three-day event, so here is my recap of Day 2, Wednesday Aug 3, 2016.
IBM Spectrum Scale overview and update
This session was covered by Mack Kigada, IBM Executive Consultant for the "Executive Advisory Practice" portion of Systems Lab Services. This session explained the basic features of Spectrum Scale, including the latest features of version 4.2, and related Elastic Storage Server pre-built systems.
Software Defined Storage - IBM Spectrum Overview
This session was presented by Saumil Shah, IBM Spectrum Protect Sales Leader for Middle East, Turkey & Africa. Since SDS is an important topic, the conference coordinators schedule several speakers to present at different time slots, to give everyone a chance to hear the SDS message. Rather than using my same charts, Saumil used his own deck, which he customized based on his experience working in this region.
Flash and the Next Generation Data Center
This session was covered by Firat Ozturk, IBM FlashSystem Sales Leader for Middle East, Turkey & Africa. While IBM offers all-flash array versions of its DS8000, SVC and Storwize product lines, Firat focused on the IBM FlashSystem family, including the FlashSystem 900, FlashSystem V9000, and the new A9000/A9000R models.
According to IDC, Flash-based technologies are predicted to represent 50 percent of the storage capacity sold in 2018. Today it is about 10 percent, so that is a big leap. The primary reason he feels are new applications like Cloud and Mobile that are driving customer expectations to faster performance.
Which product should you get? Firat indicated that the FlashSystem 900 is ideal to boost the performance of specific applications, like Oracle or SAP HANA. The FlashSystem V9000 borrows all the code base from SVC and Storwize with Real-time compression ideal for OLTP and Database applications, while offering Storage Virtualization to protect your existing storage infrastructure investment. The FlashSystem A9000 and A9000R are targeted to Cloud deployments, as well as Server Virtualization and Virtual Desktop Infrastructure (VDI).
What is Big Data? Architectures and Practical Use Cases
I have been presenting this since 2013, but still draws a new crowd every time. Based on my [2015 Presentation], I made some updates to reflect IBM's latest support for Spark, and the new POWER8 solution offerings.
Storage Tiering on z Systems: Less Management, Lower Costs, Less Management, and Increased Performance
When I present Storage Tiering for distributed systems, I typically focus on Easy Tier feature of SAN Volume Controller, the Analytics-based storage optimization of Spectrum Control, and the Information Lifecycle Management (ILM) policies of Spectrum Scale and Spectrum Archive. This time, Glenn Anderson asked me to give this a "z Systems" slant, for a mainframe-oriented audience.
In this new version, I focused on Easy Tier on IBM DS8000 systems, Hierarchical Storage Management in DFSMShsm, and the new Class Transition features that were introduced initially with DFSMSoam for objects, and now extended for data sets.
Linux on IBM z Systems and its Participation in Open Source Ecosystem, including Blockchain
Wow! What a long title!
This session was presented by Holger Smolinski, IBM Senior Performance Analyst Linux and KVM on IBM z Systems from the Boeblingen, Germany Lab. Back in the late 1990s, Holger and I worked on porting Linux to the S/390 platform. I led a team to test all of the device drivers for IBM disk and tape storage systems, working with Holger and his team to fix the drivers and submit them to the Open Source Community, so that they would be incorporated formally into the latest Red Hat and SUSE distributions.
Holger gave quite an extensive overview of the entire Open Source Ecosystem that run on Linux on z System mainframes. Over 60 percent of new mainframe customers use Linux on z Systems operating system, and the complete set of capabilities, makes this quite practical.
One of the latest of these is [Blockchain], a new way to track transactions between organizations. The open source project for this is [HyperLedger]. Transactions are recorded into blocks that are encrypted with a hash code, which prevents tampering and fraud. These blocks are then chained together as transactions occur between organizations.
For example, if a product is manufactured in China, shipped over the Pacific Ocean by a shipping company, received at a port in the United States, processed by US Customs, then shipped via trucking company to the buyer, these all would be represented as transaction blocks chained together.
Wednesday we had free evening to explore on our own. Some of my colleagues went to an all-you-can eat steakhouse for dinner, but I will get plenty of that in my upcoming trip to Sao Paulo, Brazil, so went elsewhere.
Last week, I presented at the "IBM TechU Comes to You" event in beautiful Nairobi, Kenya. This was a three-day event, so here is my recap of Day 1, Tuesday Aug 2, 2016.
Opening Keynote Session
Once again, Marlin Maddy, IBM Manager of Worldwide Systems Technical Events, served as master of ceremonies. He arrived into Nairobi just a few hours earlier, and we were worried that one of us might have to jump in and take over if he had any delays in his flight schedule. Fortunately, he arrived and did a great job welcoming the audience.
Eric Jaoko, chief manager of Kenya's Rural Electrification Agency [REA], presented next. Back in 1973, the Kenyan government wanted to have all of its rural areas offering electrical service. Some 30 years later, in 2002, only 4 percent of the rural areas had achieved this. In 2006, the Kenyan government formed this new REA agency to accelerate the progress. By 2008, nearly 25 percent of rural areas were electrified. Currently (2016), they are now at 68 percent, including all primary schools (more than 20,000 across the country).
Eric mentioned that this success was in part to their partnership with IBM for Information Technology. REA switched from Oracle to SAP applications on IBM Power systems with IBM Storwize V7000, resulting in lower costs, less power consumption, easier to deploy and manage, redundancy and high availability, scalability and high speed access to critical data. Not surprisingly, IBM's leadership in "Mobility" plays another key role, since these areas are rural and often connected only by cellular phone service.
REA employees both AIX and Linux on POWER operating systems, and uses OpenStack to manage both the servers and storage components. PowerVM, PowerVC and PowerHA complete the solution to provide a more robust environment. REA found it was very easy to clone their SAP systems, which made it very easy to test software upgrades without impacting their production environments.
The next speaker was IBM's own Glenn Anderson, IBM z Systems Consultant and Worldwide Technical Events Content Manager. His talk was titled "Think Outside the Cubicle" to emphasize that there are changes underfoot in the IT industry. Rather than focusing on IT as a cost to be reduced, enlightened CEOs are discovering that IT can be used to optimize value for their organization.
One trend that has changed drastically is what IBM refers to as "Systems of Engagement". To better connect with clients, customers and suppliers, organizations now create conversations on social media channels, listen and react to those conversations, building communities that allow them to better understand and serve their markets.
Another trend was "Two-speed IT", often called "Bimodal IT", which indicates that some projects should have "fast-track" status, streamlining the process of design, development and deployment for new innovations. This is in contrast to traditional "slower" projects for mission critical "Systems of Record" operations, like databases and Online Transaction Processing (OLTP).
His last trend he covered was this notion of "Cognitive Business", the use of self-learning, natural language processing to assist in business decision making. Glenn compared the old way as a static map that indicated "You Are Here". The new way was more like GPS, which indicated where you are, where you want to be, and the steps to get there.
(You might ask "Why do business leaders need such assistance?" First, business executives cannot ingest and comprehend the vast amount of data they need to make correct decisions, causing them to make less-than-optimal choices with limited information. Second, business leaders are often only on the job a few years, moving around from one opportunity to another, and do not build the experience background that a computer that can ingest millions of documents can achieve much more quickly. Third, business leaders often are prone to bias, surrounding themselves with ["yes-men"], unwilling to accept any information that contradicts their world view. Computers do not have that bias, and are capable in finding insights, trends and patterns that business leaders might not have considered.)
Software Defined Storage -- What? Why? How?
I was honored to be asked to be the keynote kick-off for the IBM Storage track of this conference. There is still much confusion over the concept of Software Defined Storage (SDS). While there are many different positions on this, IBM has adopted the IDC definition, which requires all three criteria to be met:
Solutions based on Industry-standard, off-the-shelf components.
Solutions that offer the complete set of storage features and functions, such as point-in-time copies, data footprint reduction, technical refresh migration, and remote replication.
Solutions that are offered in multiple ways, such as software-only, pre-built systems using industry-standard off-the-shelf components, and cloud-based services.
IBM's SDS offerings include all of the IBM Spectrum Storage family available as software-only, pre-built systems like SAN Volume Controller and XIV Gen3, and cloud-based services like IBM Cloud Managed Backup and Archive, and IBM Cloud Object Storage System (formerly Cleversafe).
IBM ranks #1 in SDS marketplace, with over 40 percent marketshare. The advantage of IBM's approach is that it does not require a complete rip-and-replace of existing IT infrastructure. IBM solutions can work with your existing servers and storage that you have already in place! This allows for a smooth and graceful transition.
Cloud Computing Concepts and the Role of Infrastructure
This session was covered by Mack Kigada, IBM Executive Consultant for the "Executive Advisory Practice" portion of Systems Lab Services. Frankly, I think this should have been classified as a "Cross-Brand" rather than other "Storage", as it showed not just storage but also how servers and OpenStack participate in a complete Hybrid Cloud solution.
The new IBM FlashSystem A9000 GUI
This session was presented by Dominique Salomon, IBM Certified IT Specialist Storage and European New Technology Introduction Leader. He works at the IBM Montpelier Briefing Center in France, a sister organization to the IBM Tucson Executive Briefing Center that I work in.
When IBM was ready to launch its newest FlashSystem offering, which combines the low-latency IBM FlashCore technology from IBM FlashSystem 900 with the IBM Spectrum Accelerate software from XIV, they had to decide what Graphical User Interface [GUI] to deploy it with. The IBM development team had narrowed it down to three options:
Use the IBM XIV Gen3 GUI, which is installed client code that runs on a handful of select operating systems. This GUI is nine years old.
Adopt and modify the browser-based GUI used by all of the other IBM Storage systems like DS8000 and SAN Volume Controller. By using HTML5, AJAX and Dojo widgets, this newer approach eliminates Operating System and Java dependencies, and can run on desktops, laptops, tablets and smartphones. However, this technology is four years old.
Deploy a new GUI, adopting the latest techniques and methods, offering a new, simpler way to manage the new device.
The development team decided on the third option, and so Dominique spent the first half hour explaining what the IBM FlashSystem A9000 and A9000R systems are, and then the last half showing a live demo connecting back to his systems in Montpelier, France.
IBM XIV, Spectrum Accelerate and the new IBM FlashSystem A9000
This session was covered by Maurice "Mo" McCullough, IBM Storage Technical Content Leader for IBM Systems Worldwide Technical Events. In retrospect, he admitted that he should have scheduled this session before Dominique's session above, which would have reduced the amount of time and questions Dominique spent explaining the IBM FlashSystem A9000 and more time showing the new GUI.
Mo first covered the newest model of the XIV Gen3 pre-built system, the model 314. It has double the cache memory and double the processing cores to drastically improve Real-time compression. Then, he explained IBM Spectrum Accelerate, available as either software you can deploy on your own x86 servers on-premises, or in cloud-based servers from IBM SoftLayer. Finally, Mo covered the A9000 and A9000R, the newest members of the IBM FlashSystem family that share features and capabilities with the XIV Gen3 and Spectrum Accelerate offerings.
Tuesday evening we had a welcome reception for all the attendees, staff and speakers. This was a great time to relax and meet everyone on a social level.
Well, it's Tuesday again, and you know what that means? IBM Announcements!
New Nearline expansion enclosures for FlashSystem V9000 and SAN Volume Controller (SVC)
The new 12 Gb SAS expansion enclosure expands total capacity and delivers a tiered data solution. Each LFF expansion enclosure supports twelve 3.5-inch 8 TB NL-SAS drives. Up to two expansion enclosures are supported by a FlashSystem V9000 or SVC controller pair, delivering up to twenty-four drives and 192 TB of raw capacity. The capacity can be compressed up to 5x (80 percent savings) using IBM Real-time Compression.
IBM Spectrum Control and IBM Virtual Storage Center V5.2.10 release
IBM Spectrum Control continues its quarterly continous delivery model with version 5.2.10 release. This is also included in all variants of IBM Virtual Storage Center which bundles IBM Spectrum Control with IBM Spectrum Virtualize products. New features include:
View more details about capacity growth over time for storage systems, pools, volumes, fileset, and file systems. This helps capacity planners to plan for future purchases and procurement.
Aggregate basic information across multiple Spectrum Control servers into a single place, rolling up information was temporally removed in Spectrum Control V5.2.8 and is now available in the web-based GUI for the first time. This is intended for clients to manage multiple data center sites, but can also be used to Cloud Service Providers and Managed Service Providers to generate reporting across a group of clients.
Compare the workload and performance characteristics of IBM SAN Volume Control and IBM Storwize systems against best practice performance guidelines. This is especially useful synergy for the IBM Virtual Storage Center bundles.
Export performance data for storage systems and fabrics using a new Create Performance Support Package wizard. This is helpful in case you observe a performance problem with your IBM storage system, and the IBM support for that device would like to receive the measured performance statistics for further analysis. In the same manner that IBM Spectrum Control drastically reduces troubleshooting time for clients, it is also proven useful for IBM support teams.
Understand how the capacity of storage systems is used when storage virtualization is implemented in the environment, by looking at the information about virtualized and non-virtualized capacity. This allows storage administrators to show upper management how their investment in IBM Spectrum Virtualize (SVC, Storwize, etc.) has returned on investment.
Launch the IBM Spectrum Scale GUI from IBM Spectrum Control to deliver an even better integration of the two products.
It is hard to believe I was the "Technical Evangelist" for SAN Volume Controller when it launched in 2003. That was 13 years ago! Since then, a variety of products using the shared codes base (IBM Spectrum Virtualize) have launched, including IBM Storwize family and IBM FlashSystem V9000 mentioned above. The new IBM Spectrum Virtualize Software V7.7 delivers the following improvements:
Reliability, availability, and serviceablility with NPIV host port fabric virtualization. This is actually pretty cool feature. NPIV stands for "N-port ID Virtualization". Every Spectrum Virtualize port has an N-port ID, and if one node fails, multi-pathing software must scramble to look up its partner node and re-direct traffic to the ports of that other node. With NPIV, the partner node takes on the N-ports of both its own node, as well as the failed node, and handles all the traffic, and then gives back the N-ports back to the other node when it is back up and running.
Distributed RAID (DRAID) support for encryption. IBM added support for distributed RAID-5 and RAID-6 in the previous release, but at the time did not include the built-in encryption feature for these new kind of RAID ranks. Now it supports encryption.
Graphical User Interface (GUI) enhancements to manage your IP-based quorums. Previously, if you had a two-site configuration like Stretched Cluster or HyperSwap, best practices would require a third location as "tie breaker". Thus, people ran fiber optic cables from both sites to a third location, with a small disk system in a closet somewhere. The IP-based quorum is a little Java program you can run on any system, and so long as both sites have LAN or WAN access, serves the same role.
Graphical User Interface (GUI) enhancements to run the "Compresitmator" tool. The Comprestimator tool can run against existing volumes (vDisks) to identify estimated compression savings.
Flexibility Virtualization of iSCSI-attached and Fibre Channel-attached external Storage arrays. Previously, only Fibre Channel (FCP and FCoE) back-end devices could be virtualized. Initially, this will support iSCSI virtualization of IBM Storwize and Dell EqualLogic.
Performance with 64 GB read cache. The software code was enhanced to take advantage of 64-bit memory addressing to support larger read cache.
Software licensing metrics to better align the value of SVC software with Storage use cases through Differential Licensing, based on Storage Capacity Unit (SCU). The licensing for SVC has base and compression license based on the back-end (managed physical usable capacity), and then various features that are based on the subset of front-end capacity (virtual volumes). The new Differential Licensing applies SCU to the back-end (base license and compression). The front-end features continue to be TB-based.
IP Link compression to improve usage of IP networks for remote-copy data transmission
Differential Licensing based on Storage Capacity Unit (SCU)
Differential licensing based on new concept IBM calls Storage Capacity Unit (SCU). Previously, software was licensed per Terabyte (TB), but that treated all TB the same, from Flash to Nearline disks. The new license method takes storage media into three categeories:
1 SCU equals 1.00 TB of Flash and Solid-State Drives (SSDs), and any other storage not listed in the categories below.
1 SCU equals 1.18 TB of 10K and 15K rpm drives, such as Serial Attached SCSI (SAS) Drives and Fiber Channel Drives, as well as systems using "Category 3" (Nearline or SATA drives) with advanced architectures to deliver high-end storage performance, such as IBM XIV Storage System, HP 3PAR or Infinidat .
1 SCU equals 4.00 TB of 7200 rpm Nearline SAS (NL-SAS) and Serial ATA (SATA) Drives
This new licensing is experimental. I would be interested in your feedback.
Well, it's Tuesday again, and you know what that means? IBM Announcements!
Last week, IBM announced a variety of tape system enhancements.
IBM TS7760 Virtual Tape System
The IBM TS7760 combines the benefits of the previous TS7720 and TS7740 offerings. Those with IBM z System mainframes will recognize both. The TS7740 has a small amount of disk that pretend to be a tape library, with enough capacity to hold a few hours to a few days worth of data. After that, the data is moved to physical tape. The TS7720 is an all-disk solution, holding up to 1 PB of disk to hold weeks or months worth of data, but did not have tape attachment. Previously, IBM announced the TS7720T, a high-capacity offering with tape attachment. The new TS7760 is now the replacement for all three of these, powered by the latest POWER8 processor.
In addition to all the features available in the former models, the new TS7760 uses 4TB drives instead of 3TB drives, resulting in a maximum capacity of 1.3PB of disk capacity before compression. The disks are encrypted and protected by distributed RAID-6 referred to as "Dynamic Disk Pooling". While tape attachment is still optional, it supports both IBM TS3500 and TS4500 tape libraries.
Well, it's Tuesday again, and you know what that means? IBM Announcements!
IBM ProtecTIER TS7650G model DD6 supports File System Interface (FSI)
The IBM ProtecTIER Data Deduplication appliance (TS7620) and gateway (TS7650G) support three protocols used by major backup software products:
VTL - Virtual Tape Library. Originally, backup software products were designed exclusively to work with tape drives and libraries. To introduce disk-based storage and data deduplication, the easiest way was for disk-based systems to pretend to be a tape library. Hence, "Virtual Tape Library" acts just like a physical tape library.
OST - OpenStorage Technology API, a proprietary interface used exclusively by the Veritas NetBackup software to talk to disk-based backup repositories.
FSI - File System Interface, which are your familiar NAS interfaces like NFS and SMB (formerly known as CIFS). Some backup software like Commvault Simpana are optimized for NAS storage pools.
In the past, FSI was limited to the single-controller models. This is because having an active/active file system sharing was very complicated to implement.
In the new DD6 dual-controller model, you can now run two independent FSI instances, each controller owns its own set of files. To learn more, see the IBM Press Release [IBM ProtecTIER DD6 supports FSI].
IBM TS3000 System Console enhancements
The Tape Storage System Console (TSSC) is a console that allows administrators to manage up to 24 systems in tape libraries (such as TS3500 and TS4500) and virtual tape systems (such as TS7720T and TS7650G). The new features include:
Error-initiated problem reporting, often called "Call Home" support, with staged, error-specific data gathering for support
Automatic wellness checking
Remote services such as remote monitoring support and call-in capability with authenticated access through a modem or broadband, including file transfers and multiple connections with attached systems
IBM offers two sets of products for entry-level and midrange disk systems:
Storwize V7000 and V5000 products are optimized for random-access workloads like Virtual Machines (VMs), Databases, Email and other Online Transaction Processing (OLTP).
The DCS3860 and DCS3700 are optimized for sequential throughput, like video streaming, batch processing or big data analytics.
Prior to this announcement, the DCS3700 and DCS3860 supported 4TB and 6TB Nearline 7200 rpm drives, and 800GB and 1.6TB Solid-State Drives (SSD). Obviously, it doesn't make sense to offer SSD on sequential-oriented solutions. To align better with this worldview, IBM is discontinuing the SSD options, and adding a new 8TB Nearline drive option.
IBM Spectrum Control Advanced Edition and IBM Virtual Storage Center
Earlier in my career, I was the chief architect of what is now called IBM Spectrum Control. If you still have IBM Tivoli Storage Productivity Center (TPC) Standard Edition V4.x products, you can now migrate to IBM Spectrum Control Advanced Edition V5.2 by ordering a trade-up part number through Passport Advantage.
IBM Virtual Storage Center (VSC) Entry uses a per-TB pricing model. This is a discounted version of VSC "Classic" for those with four or fewer SAN Volume Controller (SVC) node pairs, and 500 TB or less managed storage capacity per enterprise.
I love Hollywood movies where the main character joins the [Witness Protection Program]! For those not familiar, this is when a person witnesses a horrible or obscene crime. To protect the witness from the criminals, the US Government would change your name, create a new identity, and move you to a new city until the trial is over. While this hides the witness from the bad guys, it also means losing touch with all your friends and family.
I mention this because every time IBM renames an existing product, modifies the code to meet IBM standards, translate to other international languages, and all the other activities needed to [assimilates the product into the IBM "Borg"], it is very similar to joining the Witness Protection Program.
(Internally, we refer to this renaming and assimilating as "blue-washing", not to be confused with the traditional definition of "bluewash" -- To tout a corporation's commitment to social responsibility, and to use this perception for public relations and economic gain; to present a humanitarian front in this manner, which IBM also does. See this article [Sesame Workshop and IBM Watson Team Up to Advance Early Childhood Education] for an example.)
Last November 2015, [IBM acquired Cleversafe] for $1.3 Billion US dollars because Cleversafe has the brand name recognition as the #1 Object Storage vendor the past two years in a row (2014 and 2015). Unfortunately, Cleversafe has "witnessed" a huge rise in obscene profits and revenues, and is now joining the "Witness Protection Program".
Renaming Cleversafe software, pre-built appliance hardware, and related cloud services to [IBM Cloud Object Storage System] is like someone acquiring the Coca-Cola company and renaming their namesake soft drink product to "Brown Carbonated Sugar Liquid", which adults might shorten to "Bro-Carbo" and the kids would nickname "Sugar-Liq".
(FCC Disclosure: I work for IBM. This blog post can be considered a "paid celebrity endorsement" for IBM Storage products. I have no financial interest in the Coca-Cola Company, CBS Television, Paramount Pictures, or Warner Bros. I have no knowledge of any IBM's future plans in acquiring any beverage-based manufacturing or bottling companies. I use Coca-Cola® merely as a well-recognized brand for illustrative purposes.)
Honestly, I don't know if "IBM Cloud Object Storage System version 3.8" offers any new features over "Cleversafe 3.7", or if the numbering change was just to help avoid confusion with existing v3.7 clients.
The IBM 3592 Tape Controller Model C07 which provides FICON access for mainframe attachment did not meet the Restriction of Hazardous Substances [RoHS] directive. This is the directive to not have lead-based paint or other hazardous substances in the paint, plastic or other materials in IT equipment.
IBM had a tough business choice. Either fix it, or stop selling it. Our mainframe clients just don't use physical tape anymore. Instead, IBM offers IBM Virtual Tape Systems (TS7720, TS7720T and TS7740) as well as the IBM ProtecTIER TS7650G Mainframe Edition.
In journalism, this is called [burying the lede]. IBM has combined the world's fastest storage, IBM FlashSystem 900, with IBM FlashSystem® A9000/A9000R Software V12.0, based on IBM Spectrum Accelerate and XIV v11 software technology.
This new software has many of the features you love from IBM Spectrum Accelerate and XIV, but adds excellent data footprint reduction. First, we eliminate repeated patterns, then apply data deduplication, and finally apply advanced compression.
This combination works great for Virtual Desktop Infrastructure, Virtual Machines for traditional applications, and even databases. Since this applies to all data, the models are priced based on their "effective capacity" based on 5.26x reduction. Different data dedupes or compresses at different rates. Your mileage may vary.
Two models were announced:
FlashSystem A9000 - This is an 8U rack-optimized solution that has three 2U x86 servers combined with a 2U drawer of FlashSystem 900 with a nice bezel on the front. This can fit into any standard 19 inch rack. Since FlashSystem offers 1.2TB, 2.9TB and 5.7TB IBM Microlatency modules, the FlashSystem A9000 is offered in 60TB, 150TB and 300TB effective capacities. Performance is at least 250 microsecond latency, up to 4.5 GB/sec throughput and 50,000 IOPS.
FlashSystem A9000R - The "R" on the end refers to "Rack". Instead of something that slides into an existing rack, the A9000R is a free-standing 19-inch wide rack with two to six flash enclosures. Each flash enclosure will have two x86 servers running the IBM FlashSystem A900R Software v12.0, and one FlashSystem 900 drawer. IBM offers both 150TB and 300TB effective capacity per flash enclosure, based on the 2.9TB and 5.7TB IBM Microlatency modules. Performance is at least 250 microseconds, up to 18 GB/sec throughput and 2 million IOPS.
Some have called these new models the "All-Flash" version of XIV, in much the same way that the FlashSystem V9000 is the all-Flash version of SVC. That is a reasonable analogy.
This week, I presented at the "IBM TechU Comes to You" event in beautiful Dubai, United Arab Emirates. This was a three-day event, so here is my recap of Day 3.
IBM Spectrum Control Family - The right products for your storage management needs
Mike Griese (IBM Spectrum Storage Evangelist) presented the IBM Spectrum Control family. There are now four editions of IBM Spectrum Control:
IBM Spectrum Control Based Edition -- comes included with specific IBM Storage products to provide Cloud APIs such as those required for VMware.
IBM Spectrum Control Standard Edition -- Includes "Based Edition" and adds monitoring, provisioning and troubleshooting for IBM and non-IBM storage devices. Also includes IBM Copy Services Manager for select IBM storage devices.
IBM Spectrum Control Advanced Edition --Includes "Standard Edition" and adds Spectrum Protect Snapshot to take application-aware snapshots, and the Storage Analytics Engine to optimize data placement.
IBM Spectrum Control Storage Insights -- A "Software-as-a-Service" subset of "Advanced Edition" for IBM storage products.
Implementation of Incremental Forever Backup and Deduplication with Spectrum Protect
This was combination of an overview of IBM Spectrum Protect plus an update of the latest v7.1.5 release. For those who use alternative backup software like Veritas NetBackup or Commvault Simpana, I explained how to implement "Incremental Forever" backup, which has been shown repeatedly by analysts and studies as being far more efficient than traditional backup methods like Full+Incremental or Full+Differential.
For those who may be using an earlier version of IBM Tivoli Storage Manager, I presented the new "Dedupe 2.0" features, including the new concept of "Container Pools" that can either be "Directory Pools" on SAN or NAS-based disk storage, or "Cloud Pools" on object storage, like IBM Cleversafe or IBM SoftLayer.
Spectrum Control Storage Insights - Redefining storage management simplicity
Mike Griese presented the newest member of the IBM Spectrum Control. Storage Insights is a Software-as-a-Service offering, that was recently reduced in price: only $250 per month for the first 50TB. Increasing amounts of storage capacity monitored are tiered at lower and lower prices.
Real-time Compression in Database environment
When it comes to compression, should you compress at the database level, or in the storage device? Database management systems like IBM DB2 and Oracle DB offer row-level or page-level compression.
IBM Real-time Compression available in IBM XIV and all of the latest Spectrum Virtualize products: SAN Volume Controller, Storwize V7000, Storwize V7000 Unified, Storwize V5000, FlashSystem V9000, as well as any of these in the VersaStack converged system from IBM and Cisco.
IBM ran tests that compared volume with database uncompressed, database-based compression, compression on IBM Storwize V7000 with IBM Real-time Compression, and a test run that does both database and storage-based compression together. The results might surprise you!
I explained the pros and cons of each method of compression, and why you might choose one or the other.
Be Ready for Object Storage with CleverSafe
Eric Forestier (IBM Montpelier) presented a quick overview of IBM Cleversafe, then did a live demo of the PUT and GET features. For example, he used the Linux CURL command to upload a video file as an object in his IBM Cleversafe cluster back in France. Then he used a regular browser to stream the video back.
Was Dubai too far away for you to attend? Want to hear the latest technical information about IBM Storage, but not willing to wait until the big [IBM Edge Conference] this September? We will have several more "IBM TechU Comes to You" events in May and June.
This week, I presented at the "IBM TechU Comes to You" event in beautiful Dubai, United Arab Emirates. This was a three-day event, so here is my recap of Day 2.
Introducing the Spectrum Storage Suite
Mike Griese (IBM WW Spectrum Storage Software Evangelist) presented an overview of the IBM Spectrum Storage family of products, and the new IBM Spectrum Storage Suite license which drastically simplifies the TB-licensing of all six products into a single number.
Spectrum Scale - introduction, use cases, competitive advantages
I presented an overview of IBM Spectrum Scale v4.2.1 release. I covered our support for POSIX, NFS, SMB, Hadoop, OpenStack Swift and Amazon S3 interfaces.
IBM Spectrum Scale is an ideal solution to replace NetApp filers, EMC Isilon or DataDomain storage devices. Use cases include clustered NAS, Object store, and Hadoop repository for analytics.
IBM Spectrum Archive -- Integration with Spectrum Scale, and its Applications in CCTV and Media
This was another special request from the UAE team, and I had a lot of fun putting it together. I started talking about IBM's recent acquisitions in video technologies, including LiveStream and ClearLeap.
I then explained how Spectrum Scale works, and how Spectrum Archive works either separately, or in combination with Spectrum Scale.
A live demo was planned to show this all off, but sadly I had network, firewall and/or VPN issues that prevented me from attaching to my Tucson-based systems. I then wrapped up with client references that have successfully used IBM Spectrum Archive in this area.
IBM Virtual Storage Center - Prepare your existing storage for the future
Mike Griese presented IBM Virtual Storage Center, which combines the "Control Plane" product of IBM Spectrum Control Advanced Edition, with the "Data Plane" products under IBM Spectrum Virtualize.
Introduction to Object Storage and its Applications - Cleversafe
I presented the basics of object store, a radical new way of storing information and how it is different from block or file-based storage alternatives.
I then covered the features of IBM Cleversafe solutions, available as software, pre-built appliances, and in the Cloud. I wrapped up with practical use cases for Content Repository, Enterprise Collaboration, Active Archive, Storage as a Service, and Backup storage pool.
Integration between IBM Spectrum Scale and Cleversafe
This was a fun session.
I presented an overview of IBM Spectrum Scale which provides volume, file and object-level storage interfaces on data that can span various flash, hybrid and spinning disk storage devices.
I gave a quick recap of Cleversafe for those who missed my earlier session.
I then showed how files can be migrated from IBM Spectrum Scale to either Cleversafe on-premises, Cleversafe in the Cloud on IBM SoftLayer, or LTFS-enabled tape using Spectrum Archive, or to any combination of disk, tape, object storage, Cleversafe and Cloud through IBM Spectrum Protect HSM and Space Management features.
Tuesday evening I went out to dinner with the z Systems team. Earlier in my career, I was the chief architect of DFSMS, the storage management element of z/OS operating system, so I continue to have close ties with the folks from Poughkeepsie.
Was Dubai too far away for you to attend? Want to hear the latest technical information about IBM Storage, but not willing to wait until the big [IBM Edge Conference] this September? We will have several more "IBM TechU Comes to You" events in May and June.
This week, I presented at the "IBM TechU Comes to You" event in the beautiful [Kempinski hotel], part of the [Mall of the Emirates] on the famous Sheikh Zayed Road in Dubai, United Arab Emirates. This was a three-day event, so here is my recap of Day 1.
Marlin Maddy (IBM Systems Lab Services) acted as emcee to kick off this event. We had about 150 attendees. Louise Hemond-Wilson (IBM Distinguished Engineer) and Glenn Anderson (IBM Systems Lab services) presented similar to last week in Atlanta. See my blog post [Atlanta Day 1 Recap] for an overview.
Software Defined Storage - What is it, How can it help?
Mike Griese (IBM WW Spectrum Storage Software Evangelist) presented his viewpoint on Software Defined Storage. His focus was on what we call "software-based" or "software-deployed" storage solutions. These are solutions that are basically software deployed on industry-standard servers, such as x86 or OpenPower, that provide a choice of server vendor.
(In Atlanta, Clod Barrera, Jeff Barnett, and I presented back-to-back sessions on Software Defined Storage (SDS). See my blog post [Atlanta Day 1 Recap] for an overview of those three sessions.)
The key difference between "Software-Deployed" storage and "Software-Controlled" storage is that the former is ideal to reduce costs by using commodity, off-the-shelf servers, but may not have all of the OpenStack, VMware or Microsoft APIs needed to effectively manage the solution as part of a large data center or Cloud facility.
If, however, you are deploying Software-deployed storage in Remote Office/Branch Office locations, Test/Dev departments, or similar small deployments, that may not be an issue.
All Flash is not Equal -- Contrasting difference between IBM FlashSystem and SSD
This was a special request by the local UAE team, because many FlashSystem presentations focus on the product, but don't explain the underlying technology, specifically what differentiates IBM FlashSystem from substantially slower competitive alternatives like EMC XtremIO and PureStorage that are based instead on fallible commodity Solid State Drives (SSD).
By working closely with our chip vendor, Micron, IBM was able to improve the write endurance of these Multi-level cell (MLC) chips by 9.4x, and reduce write amplification by 45 percent.
I explained IBM's clever asymmetrical wear-level balancing, heat segregation, read disturb mitigation, voltage level shifting, and health binning, all of which contribute to the performance and reliability of this solution. IBM's innovative Error Correcting Code provides LDPC-like correction strength but at much faster BCH-like latency speed.
This was such a popular session that I have been asked to present again at the upcoming IBM TechU events in San Francisco, Chicago and Boston.
How to combine advantage of storage virtualization & Flash performance (Turbocompression effect)
Dominique Salomon (IBM Certified IT Specialist Storage from Montpelier, France) presented Turbocompression, the benefits of combining IBM Real-time Compression (RtC) with Easy Tier sub-volume automated tiering.
Sometimes two things just go well together. Chocolate and Peanut Butter, Bacon and Maple Syrup, Peaches and Cream, are just a few pairings that come to mind.
Initially, when IBM introduced RtC, it did not allow Easy Tier on the same compressed volumes, in an effort to avoid conflicts. Then in a later release, IBM lifted the restriction, allowing them to apply to the same volumes. The results were surprising, both benefit each other. IBM has taken this further, using Easy Tier information to enhance compression algorithms on an extent by extent basis.
The combination improves performance while reducing total cost of ownership, and is available on all of the latest Spectrum Virtualize products: SAN Volume Controller, Storwize V7000, Storwize V7000 Unified, Storwize V5000, FlashSystem V9000, as well as any of these in the VersaStack converged system from IBM and Cisco.
DS8880 IBM Newest Disk Storage System
Maurice "Mo" McCullough (IBM Lab Services and Training) presented the latest DS8000 models, the DS8884 and DS8886. IBM is number #1 in storage attached to the mainframe, with 42 percent marketshare, and this is because IBM's investment in this platform, beating out HDS, EMC and HPE.
Each country and culture is different, but in many of the Islamic countries, it is considered inappropriate to serve alcoholic drinks at the after-hours reception. Instead, we had our sponsors serve juice and coffee. IBM does business in over 170 countries, and I have been to nearly half of them, so we know how to adjust and adapt to each and every unique situation.
Was Dubai too far away for you to attend? Want to hear the latest technical information about IBM Storage, but not willing to wait until the big [IBM Edge Conference] this September? We will have several more "IBM TechU Comes to You" events in May and June. To learn more, or to register for one of these, check out the [IBM Technical Events in 2016] landing page. I have negotiated [special discounts] for upcoming events in the United States for those who read this blog!