This blog is for the open exchange of ideas relating to IBM Systems, storage and storage networking hardware, software and services.
(Short URL for this blog: ibm.co/Pearson )
Tony Pearson is a Master Inventor, Senior IT Architect and Event Content Manager for [IBM Systems for IBM Systems Technical University] events. With over 30 years with IBM Systems, Tony is frequent traveler, speaking to clients at events throughout the world.
Lloyd Dean is an IBM Senior Certified Executive IT Architect in Infrastructure Architecture. Lloyd has held numerous senior technical roles at IBM during his 19 plus years at IBM. Lloyd most recently has been leading efforts across the Communication/CSI Market as a senior Storage Solution Architect/CTS covering the Kansas City territory. In prior years Lloyd supported the industry accounts as a Storage Solution architect and prior to that as a Storage Software Solutions specialist during his time in the ATS organization.
Lloyd currently supports North America storage sales teams in his Storage Software Solution Architecture SME role in the Washington Systems Center team. His current focus is with IBM Cloud Private and he will be delivering and supporting sessions at Think2019, and Storage Technical University on the Value of IBM storage in this high value IBM solution a part of the IBM Cloud strategy. Lloyd maintains a Subject Matter Expert status across the IBM Spectrum Storage Software solutions. You can follow Lloyd on Twitter @ldean0558 and LinkedIn Lloyd Dean.
Tony Pearson's books are available on Lulu.com! Order your copies today!
Safe Harbor Statement: The information on IBM products is intended to outline IBM's general product direction and it should not be relied on in making a purchasing decision. The information on the new products is for informational purposes only and may not be incorporated into any contract. The information on IBM products is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. The development, release, and timing of any features or functionality described for IBM products remains at IBM's sole discretion.
Tony Pearson is a an active participant in local, regional, and industry-specific interests, and does not receive any special payments to mention them on this blog.
Tony Pearson receives part of the revenue proceeds from sales of books he has authored listed in the side panel.
Tony Pearson is not a medical doctor, and this blog does not reference any IBM product or service that is intended for use in the diagnosis, treatment, cure, prevention or monitoring of a disease or medical condition, unless otherwise specified on individual posts.
The developerWorks Connections Platform is now in read-only mode and content is only available for viewing. No new wiki pages, posts, or messages may be added. Please see our FAQ for more information. The developerWorks Connections platform will officially shut down on March 31, 2020 and content will no longer be available. More details available on our FAQ. (Read in Japanese.)
If Eskimos have 37 words for "snow", then EMC has perhaps a similar number of names for "failure". I have already covered a few of their past attempts, including [ATMOS], [Invista], and [VPLEX]. Last week, EMC introduced its latest, called XtremeIO.
But rather than focus on XtremeIO's many shortcomings, I thought it would be better to point out the highlights of IBM's All-Flash array, IBM FlashSystem.
But first, a quick story.
Two years ago, I worked the booth at [Oracle OpenWorld 2011]. After a conference attendee had visited the booths of Violin Memory and Pure Storage, he asked me why IBM did not have an all-Flash array.
Of course IBM did, and I showed him the [Storwize V7000]. For example, a 2U model with 18 SSD drives of 400GB each, configured in two RAID-5 ranks 7+P+S could offer 5.6 TB of space, running up to 250,000 IOPS at sub-millisecond response times.
Why didn't IBM advertise the Storwize V7000 as an all-Flash array? I though the question was silly at the time, since the Storwize V7000 supported SSD, 15K, 10K and 7200 RPM spinning disk, it seemed obvious that it could be configured with only SSD if you chose.
Since then, IBM has added 800GB support to the Storwize V7000, doubling the capacity. More importantly, IBM acquired Texas Memory Systems, and offers a much better all-Flash array.
Flash can be deployed in three levels. The first is in the server itself, such as with PCiE cards containing Flash chips, limited to applications running on that server only.
The second option is a hybrid disk system, that can intermix Flash-based Solid State Drives (SSD) with regular spinning hard disk drives (HDD). These can be attached to many servers.
The problem with this approach is that when Flash is packaged to pretend to be spinning disk, it undermines some of the performance benefits. Traditional disk system architectures using SCSI commands over Device adapter loops can introduce added latency.
The third fits snuggly in the middle: all-Flash arrays designed from the ground up to be only Flash.
Whereas SSD can typically achieve an I/O latency in the 300 to 1000 microseconds range, IBM FlashSystem can process I/O in the 25 to 110 microsecond range. That is a huge difference!
(FTC Disclosure: The U.S. Federal Trade Commission requires that I mention that I am an IBM employee, and that this post may be considered a paid, celebrity endorsement of both the IBM FlashSystem and IBM Storwize family of products. I have no financial interest in EMC, do not endorse the XtremeIO mentioned here, and was not paid to mention their company or products in any manner.)
Fellow blogger and IBM Master Inventor Barry Whyte has a great comparison table in his blog post [Extreme Blogging]. I thought I would add an added column for the Storwize V7000 with 18 Solid State drives.
IBM FlashSystem 820
IBM Storwize V7000 with SSD
20 Terabytes: 1U
11 Terabytes: 2U
7 Terabytes: 6U
I/O latency (microseconds)
110us (~5x faster)
Maximum I/O per second
NAND Flash type
While it is easy to show that EMC's XtremeIO does not hold a candle to IBM FlashSystems, I think it is more amusing that it is not even as good as a Storwize V7000 with SSD that IBM offered two years ago, long before [EMC acquired XtremeIO company] back in May 2012.
Well, it feels like Tuesday and you know what that means... "IBM Announcement Day!" Actually, today is Wednesday, but since Monday was Memorial Day holiday here in the USA, my week is day-shifted. Yesterday, IBM announced its latest IBM FlashCopy Manager v2.2 release. Fellow blogger, Del Hoobler (IBM) has also posted something on this out atthe [Tivoli Storage Blog].
IBM FlashCopy Manager replaces two previous products. One was called Tivoli Storage Manager for Copy Services, the other was called Tivoli Storage Manager for Advanced Copy Services. To say people were confused between these two was an understatement, the first was for Windows, and the second was for UNIX and Linux operating systems. The solution? A new product that replaces both of these former products to support Windows, UNIX and Linux! Thus, IBM FlashCopy Manager was born. I introduced this product back in 2009 in my post [New DS8700 and other announcements].
IBM Tivoli Storage FlashCopy Manager provides what most people with "N series SnapManager envy" are looking for: application-aware point-in-time copies. This product takes advantage of the underlying point-in-time interfaces available on various disk storage systems:
FlashCopy on the DS8000 and SAN Volume Controller (SVC)
Snapshot on the XIV storage system
Volume Shadow Copy Services (VSS) interface on the DS3000, DS4000, DS5000 and non-IBM gear that supports this Microsoft Windows protocol
For Windows, IBM FlashCopy Manager can coordinate the backup of Microsoft Exchange and SQL Server. The new version 2.2 adds support for Exchange 2010 and SQL Server 2008 R2. This includes the ability to recover an individual mailbox or mail item from an Exchange backup. The data can be recovered directly to an Exchange server, or to a PST file.
For UNIX and Linux, IBM FlashCopy Manager can coordinate the backup of DB2, SAP and Oracle databases. Version 2.2 adds support specific Linux and Solaris operating systems, and provides a new capability for database cloning. Basically, database cloning restores a database under a new name with all the appropriate changes to allow its use for other purposes, like development, test or education training. A new "fcmcli" command line interface allows IBM FlashCopy Manager to be used for custom applications or file systems.
A common misperception is that IBM FlashCopy Manager requires IBM Tivoli Storage Manager backup software to function. That is not true. You have two options:
In Stand-alone mode, it's just you, the application, IBM FlashCopy Manager and your disk system. IBM FlashCopy Manager coordinates the point-in-time copies, maintains the correct number of versions, and allows you to backup and restore directly disk-to-disk.
Unified Recovery Management with Tivoli Storage Manager
Of course, the risk with relying only on point-in-time copies is that in most cases, they are on the same disk system as the original data. The exception being virtual disks from the SAN Volume Controller. IBM FlashCopy Manager can be combined with IBM Tivoli Storage Manager so that the point-in-time copies can be copied off to a local or remote TSM server, so that if the disk system that contains both the source and the point-in-time copies fails, you have a backup copy from TSM. In this approach, you can still restore from the point-in-time copies, but you can also restore from the TSM backups as well.
IBM FlashCopy Manager is an excellent platform to connect application-aware fucntionality with hardware-based copy services.
This week, IBM launched the new [IBM Expert Network] that provides presentation materials from subject matter experts. I am honored to be one of the 20-plus experts selected for PRO accounts on SlideShare.Net to help seed this with initial materials.
I have a bit of behind-the-scenes history to share on this. Back in 2008, I first discovered SlideShare.net as an excellent resource to get ideas for presentations. Much like YouTube is for videos and FlickR is for photos, SlideShare.Net is for presentations. In my June 2008 post, [Summer Jobs and the Singularity], I embedded someone's presentation from SlideShare.
This latter one got me in a bit of trouble internally. Neither presentation had anything secret or controversial, so I didn't see the issue. Several other bloggers had asked how I got "permission" to use an external Software-as-a-Service (SaaS) like SlideShare.net for my blog. I never asked for permission! I explained that since IBM's internal Lotus Connections software we use for blogging did not have a feature to embed PowerPoint (PPT) or Open Document Format (ODP) presentations, I chose an external service instead. Yes, I guess I could have converted each page to a JPG or PNG graphic instead, or I could have put the PDF on an FTP download area of the "Files" feature of Lotus Connections, but I chose SlideShare.net instead.
The result? IBM communications decided to make an official list, it's actually three lists. A "white list" of services that we are allowed to use, a "grey list" of services under evaluation or negotiation, and a "black list" of services we are not allowed to use, and sadly Slideshare.Net was on the black list. I protested, argued that unless IBM offered something to replace it, to re-evaluate this external service. I got it back on the "grey list" and now, this week, it is officially on the "white list".
Of course, this probably involved negotiation on EULA terms and conditions, but I am not a lawyer and have no idea what went on behind closed doors to make this happen. I am just glad it did.
Now that the US Recession has been declared over, companies are looking to invest in IT again. To help you plan your upcoming investments, here are some upcoming events in April.
SNW Spring 2010, April 12-15
IBM is a Platinum Plus sponsor at this [Storage Networking World event], to be held April 12-15 at the Rosen Shingle Creek Resort in Orlando, Florida. If you are planning to go, here's what you can go look for:
IBM booth at the Solution Center featuring the DS8700 and XIV disk systems, SONAS and the Smart Business Storage Cloud (SBSC), and various Tivoli storage software
IBM kiosk at the Platinum Galleria focusing on storage solutions for SAP and Microsoft environments
IBM Senior Engineer Mark Fleming presenting "Understanding High Availability in the SAN"
IBM sponsored "Expo Lunch" on Tuesday, April 13, featuring Neville Yates, CTO of IBM ProtecTIER, presenting "Data Deduplication -- It's not Magic - It's Math!"
IBM CTO Vincent Hsu presenting "Intelligent Storage: High Performance and Hot Spot Elimination"
IBM Senior Technical Staff Member (STSM) Gordon Arnold presenting "Cloud Storage Security"
One-on-One meetings with IBM executives
I have personally worked with Mark, Neville, Vincent and Gordon, so I am sure they will do a great job in their presentations. Sadly, I won't be there myself, but fellow blogger [Rich Swain from IBM] will be at the event to blog about all the actviities there.
Jim Stallings - General Manager, Global Markets, IBM Systems and Technology Group
Scott Handy - Vice President, WW Marketing, Power Systems, IBM Systems and Technology Group
Dan Galvan - Vice President, Marketing & Strategy, Storage and Networking Systems, IBM Systems and Technology Group
Inna Kuznetsova - Vice President, Marketing and Sales Enablement, Systems Software, IBM Systems and Technology Group
Jeanine Cotter - Vice President, Systems Services, IBM Global Technology Services
The webinar will include client testimonials from various companies as well.
Dynamic Infrastructure Executive Summit, April 27-29
I will be there, at this this 2-and-a-half-day [Executive Summit] in Scottsdale, Arizona, to talk to company executives. Discover how IBM can help you manage your ever-increasing amount of information with an end-to-end, innovative approach to building a dynamic infrastructure. You will learn all of our innovative solutions and find out how you can effectively transform your enterprise for a smarter planet.
"EqualLogic didn’t get 2,000 customers because people were dying to use iSCSI. It got them because it built systems that scale dynamically and because a system the size of Montana can be managed by someone as clueless as my ex-wife."
As with any acquisition, people might be asking if this is a "match made in heaven" that makes strong business sense,or another HP-Compaq debacle. Back in September, I posted [Supermarkets and Specialty Shops] to explain how the storage marketplace has two market segments. Internally, IBM distinguishesbetween "clients" and "customers". Clients are those that buy services and complete solutions from a one-stop systems vendor, such as IBM, HP, Sun, or Dell, or systems integrator like IBM, CSC or EDS. Customers are those that buy products and components, from the systems vendors I just mentioned, as well as from individual specialty shops, like EMC, HDS, or NetApp.
To reach the growing "supermarket" segment, specialty shops are dependent on systems vendors to OEM or resell their kit: EMC disk through Dell, HDS disk through Sun and HP, NetApp through IBM. Until now, EqualLogichad to make their living as a "specialty" shop, but iSCSI appeals more to SMB than large enterprises, andSMB tend to be in the "supermarket" segment, so they partnered with Sun. Here is the timeline of this likely awkwardand strained relationship:
I am not surprised that I haven't seen anything in the blogosphere yet from HP, Dell or Sun. I suspect this news meansthat Sun won't be reselling Dell's EqualLogic boxes anymore, and perhaps there is nothing more for Sun bloggers Randy Chalfant or Nigel Dessau to add to that. HP and Dell are practically non-existent in the storage blogosphere, so I didn't expect much from them either.
I did, however, expect EMC to put in their spin, given that Dell resells EMC disk, and accounts for perhaps 15% of their revenues.Now that Dell has multiple offerings, they will be instructing their channel reps when to lead with EqualLogic versus when to sell EMC, for now, until 2011, at which point may simplify their storage sales model to just EqualLogic. I don't know if Dell would do that in 2011. Depending on how quick the decline happens, EMC may have to increase the pricesof their gear, or cut into their development budgets, to make up for this loss.
I started this post because of a comment from EMC blogger Chuck Hollis, who speculates how this will impact[Dell, EqualLogic and EMC].In that post, he expresses his opinion (which I will put into a different color):
"Speculation is pretty evenly split. Neither HP nor IBM have a good, entry-level iSCSI product."
If he had left out the word "good", then that would just be a false statement, but by adding the word "good" reduces this to merely an opinion of IBM products that I disagree with. (I have no experience with whateverHP sells in this category, nor talked to any customers about their experiences, so will neither agree nordisagree with Chuck's opinion of the HP half of his statement). As for the term "Entry-level", this is fairly well defined by analysts as a storage system under $50,000 US Dollars. Actually, IBM has three good offerings.
Our basic, lowest-price model is the IBM System Storage DS3300, which does iSCSI only, like the EqualLogic offerings. This supports both SAS and SATA disks, and can attach to our System x and System p server product lines.
Our smallest model of our fancier IBM System Storage N series not only supports iSCSI, but also CIFS, NFS,HTTP, FTP, and FCP protocols, what we call "Unified Storage". The iSCSI feature is included at no additional charge, and small customers can start with this, then scale up to larger N3600, N5000 or N7000 models, andadd more protocols and software features, as their business grows.
Our next larger model, but still entry-level, is the N3600. Since the N series supports a unified multi-protocolplatform, with features like SnapLock for regulatory compliance and SnapMirror for remote disk mirroring. The IBM System Storage N series easily replaces any mix of EMC "C-boxes": Centera, Celerra, and CLARiiON.
Both the DS3300 and the N series support the various Business Applications I have discussed this week, Microsoft Exchange, Lotus Domino, SAP, Oracle, Siebel, JD Edwards and PeopleSoft. N series offers SnapManager for variousapplications to make the business value even that much better.
Chuck speculates that Dell did this to compete better against rival HP, but that doesn't make sense, sincehe feels HP didn't have much to offer in this space. Perhaps Dell did this to competebetter against IBM, the number one vendor in storage hardware, according to IDC. Looking at what IBM andNetApp have to offer, Dell may have realized that they didn't have competitive disk systems from their resellingrelationship with EMC, looked elsewhere and found EqualLogic. Meanwhile, EqualLogic probably felt that Sun wasgoing out of business, or not yet fully supportive of IP SAN environments, and decided to ["switch horses midstream"].
I met young "Sam", as she preferred to be called, back in 2006, on a safari through Kenya organized by [Phi Mu] Alumni association. My coworker Ken Hannigan, married to an alumna of Phi Mu, saw this safari advertised and invited me to join them. Samantha was brought by her grandparents. In total, there were 24 people on the trip, mostly older women in their 50s or 60s. A few brought their husbands, but in general us men were greatly outnumbered. As a young teenager of perhaps 13 or 14 years old, Sam preferred to hang out with Ken and I (the two youngest men on the trip), than her own grandparents.
One day, I asked Sam to stand in front of [Lake Nakuru] for a picture, lifting one leg like the number 4. She had no idea what I was trying to do, but went along with it. It still remains as one my favorites photos of the trip.
At this point, you might be wondering "What does this have anything to do with International Women's Day?" I suggest you watch these two videos, and then the rest of the story will make more sense.
This first video has members of our executive team explaining why International Women's Day is not just important to IBM, but to the Information Technology (IT) industry and the rest of the world as a whole. I am glad to see my sixth-line manager, Tom Rosamilia, prominently featured in the video. Tom will be our keynote speaker at IBM Systems Technical University next month [Atlanta,GA: April 29-May 3].
This second video was made my our Lab Services team, an international team of men and women that provide essential IT services to our clients. Some of these I recognize, but I only just recently joined Lab Services three months ago, so I have many more yet to meet at future events.
Did you happen to catch which video Sam was in? Hint: she was only 13 or 14 back in the picture at Lake Nakuru, in her mid-20s now, if that helps any. Did you only notice the men in the videos? Go back and watch both videos, again!
So now, the rest of the story. A few days later, all 24 of us on the safari were having lunch at a big, long table. Sam was looking sad.
"What's wrong, Sam? You look sad." I asked.
"Well, at the first tribal village, and a young boy told me I looked beautiful, and he would ask his dad to give my grandparents six cows for my hand in marriage!" she started.
"Yes, I remember that." I told her, "This is their local custom, when a boy wants to marry a girl, the boy's parents give the girl's parents something in exchange. It is called a [dowry] in some countries."
".. The next day, at the second tribal village, another boy told me I looked beautiful. He said he would ask his dad ten cows for my hand in marriage!" she beamed.
"Where is this going?" I thought to myself, tying to figure out the rantings of a teenager.
".. but then the worst thing happened. At the third village we visited this morning, a third boy said I was beautiful, but only offered eight cows. Somehow, I have gone down in value in just two days, and that makes me sad." she sighed.
In an effort to cheer her up, I showed her the photo of her in front of the flamingos from my digital camera. She looked at it closely, and noticed many of the flamingos behind her also had one leg up, in the shape of the number 4.
"Hey, how did you get all the [flamingos] to lift up their legs at the same time as me for this picture?" she asked.
"I didn't. I think they saw you do it, and since you were wearing a pink shirt, felt that you were one of them and followed your example. You are a natural born leader, so don't let anybody, especially a young boy that you just met, ever, ever convince you that you are worth less than ten cows." I even wagged my finger for emphasis.
That cheered her up, but suddenly the table immediately became quiet. One by one, the ladies at the table shared their own stories. Several were in tears. They all agreed my advice to Sam was spot on, and they wished someone told them something along those lines back when they were teenagers themselves.
Sadly, I have no idea what Samantha Caldwell is doing today. As far as I know, she is not working at IBM, and not in any of the above videos, but she could be working in IT. Who knows? Her life could have gone in so many directions in the past 13 years.
Maybe, if enough people forward this to their coworkers, friends and family, it will eventually reach Sam. I hope she is doing well, and I hope my little piece of advice helped her get through the rest of her teenage years, and into her adult life.
Continuing my coverage of the [IBM Edge2014 conference], IBM's premiere conference for System Storage and related products, I attended keynote sessions on Tuesday morning, titled "Delivering on the Promise of the Future: Made with IBM".
Once again, Stephen Leonard, IBM General Manager, STG Sales, served as emcee for this general session. Yesterday, the executives focused on the "What" and "Why" for new IT initiatives. Today, they want to tackle "How" to accomplish all this.
Robert LaBlanc, IBM Senior Vice President, Software and Cloud Solutions
Robert estimates that 70 percent of enterprises will pursue dynamic hybrid clouds by 2015. Big data and analytics represents a $17 trillion USD opportunity, about 25 percent of the total IT industry.
IBM helps companies extend what they already have to what they need. In the future, people will ask "Who remembers building a private cloud stick-by-stick?" Today, IBM supports the deployment of patterns of expertise that can work on-premise IBM PureSystems. These can easily be moved or deployed off-premise to IBM SoftLayer private and public cloud offerings.
Snehal Antani, CIO of GE Capital
IT has shifted from the "back office" to the very core of business. Technology now allows GE Capital to go quickly from whiteboard to roll-out.
Not everyone is on-board. At GE Capital, people are encouraged to be like [Tigger", the adorable character from Winnie the Pooh stories, to lead efforts of innovation and collaboration. Cynics are tagged as [Eeyores], always finding a reason or excuse why plans won't work. Finally, we have "Kings and Queens", eager to be offended that any changes are needed at all.
Snehal also mentioned their "No squirrel" policy. If you have seen the movie "Up!", you know that the dog was constantly distracted by squirrels, or things he thought were squirrels. Many IT people fall the latest "shiny object" in technology.
Arvind Krishna, IBM General Manager of Development and Manufacturing
Arvind feels that "data" is the new base of new business value, in the same manner as steam, electricity and hydrocarbons had done in past centuries. In the past, most data was stored in databases, but today over 90 percent is unstructured.
In 2008, there were more "things" than people attached to the Internet, and this [Internet of Things] is expected to exceed 1 trillion items by 2015.
Have you ever wondered how the NFL plans each year's football game schedule, balancing 32 teams across five television networks? There are over 800 quadrillion possible combinations!
Borrowing the analogy from Snehal from GE Capital, the football teams are the Eeyores, and the networks are the Kings and Queens. This year, three of the games will be played in London, England. With IBM's help, the NFL was able to finish the 2014 schedule earlier than before.
Maria Winans, IBM Vice President, Social Business
Maria started with an interesting anecdote:
Lily Robinson, age 3, sent a letter asking a local grocery chain Sainsbury why their "tiger bread" was not called "giraffe bread" as it looked more like the spots on a giraffe. A manager provided a nice reply. Her parents posted it on social media, the conversation went viral, and [Sainsbury changed the name of their product] to "giraffe bread".
This is an example of "People-centric" engagement, rather than dealing with consumers in marketing segments or categories of gender or race. People will share personal data with companies they trust. Smarter companies use this data to provide the right experience at exactly the right time.
Maria explained IBM AlwaysOn Engagement Center which allows companies to track social mentions. For example, there were over 52 million social mentions of IBM Edge 2014 so far during its first two days!
The process is not just for clients, customers and consumers. It can be used to engage individual employees to drive business outcomes, or individual citizens to deliver sustainable economic growth and improve living standards.
This was a nice balance, combining IBM executives with client testimonials.
For those on Twitter, my handle is @az990tony and the hashtag for this event was #ibmedge.
Continuing my coverage of the [IBM Edge2014 conference], IBM's premiere conference for System Storage and related products, here are my notes from the morning of Day 1.
IBM Storage Trends and Directions
Clod Barrera, IBM Chief Technical Strategist for IBM System Storage, and Axel Koester, IBM Chief Technologist and Executive IT Specialist for IBM System Storage, co-presented the first session of the conference.
Nearly all storage users are struggling with the combined effects of significant capacity growth, data as both an asset and potential liability, and the lack of staff and expertise to exploit new technology.
In addition to [Systems of Record], representing the traditional workloads of databases and on-line transaction processing (OLTP), we are now seeing [Systems of Engagement], which represent new workloads such a mobile apps, social business, and big data analytics.
We are now at a tipping for Flash. IBM FlashSystem can perform I/O in about 100 microseconds, which is roughly 10x faster than solid state drives (SSD), and 50x faster than spinning disk. For those clients who value performance, this can easily justify its use.
Take for example an IBM Power system running DB2 PureScale application with 43,000 transactions per second, including 13,000 updates per second, that result in 1.3 million IOPS to the back-end storage. This can be accomplished with either (a) all-disk 5,000 spinning disk spindles, (b) hybrid 2,500 spinning disk spindles combined with 128 solid state drives (SSD), or (c) IBM FlashSystem.
The comparisons are astounding. The IBM FlashSystem solution is 11x less expensive then the hybrid system, and 14x less expensive than the all-disk solution. The solution also uses 26x less energy, and 80x less space in the data center.
Clod also feels that Software Defined Storage has come of age. IBM has three offerings in this area. The first, code-named Elastic Storage, represents IBM's General Parallel File System (GPFS) and GPFS-based products like SONAS and Storwize V7000 Unified. The second is the IBM SmartCloud Virtual Storage Center and Storwize family of storage hypervisors. The third is IBM XIV Storage System.
Software Defined Storage can be used in private, hybrid and public clouds. In 2013, only 22 percent of storage was Cloud, but this is expected to grow to 50 percent by 2017.
IBM will support a range of Software Defined Environments, from the highly proprietary VMware, to the open source OpenStack foundation. Where applicable, IBM will provided added value above and beyond the basic OpenStack infrastructure.
Axel Koester presented storage futures. He works closely with IBM Research and described some of the projects they are working on:
120PB file system solution that involved a grid of IBM POWER 775 servers. Instead of traditional RAID, the system used GPFS Native Raid, which offers an 8+3 Reed Solomon protection scheme.
Multi-cloud storage that allows you to access storage from multiple public providers without having the bottleneck of a single master scheduler.
Phase Change RAM (PCRAM) which does not rely on capturing an electrical charge. This will be 12x faster than PCIe Flash, and 275x faster than consumer SSD.
Liquid state storage. Rather than solid state, metal is kept in its liquid state to store binary information.
Finally, he mentioned IBM Research's success at storing a single bit of information in just 12 atoms. To do this, the folks at Almaden Research Center had to manually move the atoms into place using the needle of a scanning tunneling microscope [STM] to nudge each atom into position.
Axel gave a great example of scale. An atom compared to a tennis ball is like a tennis ball compared to the entire planet Earth. If an atom was the size of a tennis ball, the point of the STM needle would be the size of Mount Everest, but upside down.
IBM's Smarter Storage Strategy
In previous years, my session on Storage Strategy was scheduled on Wednesday or Thursday, and attendees would comment "Why wasn't this sooner in the week? Everything makes more sense now!"
This time, I was featured immediately after Clod and Axel's keynote session, resulting in hundreds of attendees in a large standing-room-only ballroom. The session was repeated Thursday morning for those who were turned away.
IBM's storage strategy has three main themes.
First, IBM is focused on data-intensive solutions such as big data analytics. This means storage needs to be efficient to manage the growth in a cost-effective manner. IBM offers real-time compression and data deduplication to be capacity-efficient, Flash, Nearline drives and tape to be energy-efficient, and extremely easy-to-use graphical user interfaces and automation to be labor-efficient.
Second, IBM wants to optimize business critical workloads. IBM wants to eliminate the manual effort needed to balance between performance versus cost. IBM Easy Tier, I/O priority manager, and FlashSystem solutions are just a few examples.
And third, IBM wants to help you start quickly, and add value, by deploying private, public and dynamic hybrid cloud environments. IBM is not limiting its solutions to just VMware, but rather supporting other server hypervisors including KVM, Hyper-V, PowerVM and z/VM. IBM is a platinum sponsor for OpenStack foundation, and IBM storage systems support Cinder interfaces.
For those on Twitter, my handle is @az990tony and the hashtag for this event is #IBMEdge.
Continuing my coverage of the [IBM Edge2014 conference], IBM's premiere conference for System Storage and related products, here are my notes from the afternoon of Day 1 at the general keynote sessions.
Stephen Leonard, IBM General Manager, STG Sales, served as emcee for the general session.
Tom Rosamilia, IBM Senior Vice President, STG and ISC
Tom (my fifth-line manager, BTW) started off with a joke: "All this talk about Cloud, but it has to run on hardware somewhere!"
Tom insists it is imperative for clients to build an infrastructure that enables business growth. However, less than 10 percent of clients are ready for Cloud, Analytics, Mobile or Social (CAMS) initiatives. Clients need to embrace these new workloads, ensure right-time decision making, and integrate front-office with back-office IT systems.
Tom is also proud that IBM's Software Define Storage solutions manage over 1 [Yottabyte] of information today. That's a billion Petabytes, in case you were wondering. If all of this data was stored on 1TB disk drives, instead of a mix of disk and tape, it would take over one million city blocks to house all the data centers required.
Tom indicated that data is to the 21st century what steam was for the 18th century, electricity was for the 19th century, and hydrocarbons were for the 20th century.
Tom invited Mike Reagan, CIO of Cleveland Clinic in Abu Dhabi, to say a few words on why Infrastructure matters to his IT environment. The [Cleveland Clinic in Abu Dhabi] is a 364-bed multi-specialty facility, the first US-hospital replicated outside of North America.
Mike explained their great success partnering with IBM to develop a private cloud solution. Each patient has a bedside tablet that can be used to control the entertainment, lighting, temperature and window shades. It can also be used to Skype with family and friends. The facility is four times the floorspace of the Sands Expo that this event is being helenovo 61 CES awardsld in.
Jamie Thomas, IBM General Manager, Storage and Software Defined Systems
Jamie feels that data is all about security and economics. Storage admins must become the new [data scientists] for IT.
It is important to integrate traditional "Systems of Record" with new "Systems of Engagement" workloads. Her focus areas are Software Defined Storage, Flash technologies, and storage virtualization. Specific examples included:
Mike talked about how important Electronic Health Record [EHR] systems and advanced clinical diagnostics are to help make the right medical decisions.
Greg explained that Citi was operating at global scale in 100 countries. Citi partnered with IBM to deploy commodity compute servers, 10GbE/40GbE Ethernet networking and IBM Software Defined Storage to achieve Cloud economics and Cloud scale. Citi can't afford for server, storage and network admins to work separately.
Rather than contesting [Hewlett-Packard CEO Meg Whitman's FUD about this deal], Adalio took the high road, and focused on IBM's success in the x86 server space. New offerings include the X6 architecture, including PureSystems and the NextScale dense computing platform.
Adalio invited Christian Teismann, Lenovo, on stage. Christian re-iterated that IBM and Lenovo are both committed to a smooth transition, continuing IBM's roadmap for the x86 server platform, and full consideration for the x86 servers and related storage, software, service and maintenance.
IBM has had a strong relationship with Lenovo already with the acquisition of IBM's PC division, and now this deal brings together Chinese supply chain efficiency with Western ideals and design principles. Lenovo has about 46,000 employees, nearly 4,000 R&D engineers, and will acquire an additional 7,500 IBMers when the deal completes.
Adalio then invited two clients to join him on stage: Ron Grabyan, Manager of Data Warehousing Services at [Southern California Edison], and Rohit Lal, IT Direction of Coca-Cola.
Ron indicated that actionable insights must be fast for productivity. He mentioned the funny [MetLife television commercial featuring Charlie Brown and Lucy] declaring that term-life insurance should cost only "five cents" per month. In the same manner, end users often request that response times should be short. IBM was able to get response times from 40 seconds down to "5 seconds" by helping Ron deploy SAP HANA. Another process that took 53 minutes was down to 1 minute 20 seconds.
Rohit talked about their exciting new "Coke One North America" (CONA) project. This will provide consolidated IT services for 6 different Coca-Cola bottlers in North America. With $46 Billion USD in revenue serving 1.8 billion servings of beverage per day, the use of Analytics, SAP HANA and private cloud were critical to their business.
The industry recognizes Lenovo as a major x86 player, having had 20 quarters of growth outpacing the market. Lenovo has [won 61 CES 2014 awards], more than the other top five x86 vendors combined. IBM x86 servers are ideal for Enterprise solutions, Cloud, HPC, embedded designs, and IT infrastructure deployments. IBM is #1 in x86 server customer satisfaction, #1 in x86 server up-time, and boasts the #1 fastest x86-based supercomputer. IBM and Lenovo want to take this to the next level: #1 leadership in every x86 category.
For those on Twitter, my handle is @az990tony and the hashtag for this event is #IBMEdge.
Continuing my coverage of the [IBM Edge2014 conference], IBM's premiere conference for System Storage and related products, I attended EdgeTalks: Innovation That Impacts Our World that offered a series of inspiring talks styled after the famous [TED] conferences.
Surjit Chana, IBM Chief Marketing Officer (CMO) and VP of Strategy for IBM Systems and Technology Group, served as emcee to introduce the speakers.
Ron Finley, Renegade Gardener
Back in 2003, "South Central" was [renamed to South Los Angeles]. But as everyone in IT knows, merely renaming something doesn't fix any of its problems. Ron was tired of seeing empty lots filled with old mattresses, used condoms and discarded tires, and wanted to beautify his immediate surroundings by planting vegetables in his front yard.
Ron's army of volunteers, the [L.A. Green Grounds], filed a petition. As of October 2013, it is now legal to grow food on your parkway in Los Angeles.
Ron explained that South Los Angeles is a [food desert], where it is nearly impossible to get healthy, organic food. He is concerned the "drive-thrus" of fast food restaurants kill more of his neighbors than [drive-by] shootings.
Ron has discovered this problem is not limited to Los Angeles. The American food system is designed to fill you with processed food and chemicals, made worse by a health care system happy to cut you open or prescribe you more chemicals and drugs. Everywhere processed food goes, chronic disease follows. The USA exports obesity to the rest of the world.
"To change a community, and you must first change the composition of the soil." -- Ron Finley
The rise in cancer, diabetes, and childhood cardiac arrests inspired Ron to start the [Ron Finley Project] consisting of community farms, a marketplace that accepts EBT, SNAP and other government food programs, and portable "container cafes" based on standard shipping containers that could be placed near a garden to help sell the food grown locally.
John Wilbanks, Chief Commons Officer at Sage Bionetworks and Senior Fellow in Entrepreneurship for Faster Cures
We live in the age of cheap data. John prefers the term "cheap data" rather than "big data". Mapping the first human genome cost $3 Billion USD, now John can get his own genome mapped for about $1200.
John feels this cheap data changes the way we justify our opinions. From baseball scouts to the analytics demonstrated in the movie [Moneyball]. President Barack Obama used social media to help win elections. And cheap data is coming to health and medicine.
John gave an interesting example. A grad student wanted to study alcoholism among undergraduate students. The traditional method would have been to gather privacy permission slips from volunteers. Instead, he "friended" 4,000 undergraduates, and looked on social media containing the [distinctive color of red beer cups] for photos taken on Monday through Wednesday, indicative of a drinking problem. This innovative approach allowed the grad student to complete his research in less than six weeks.
Cheap data doesn't mean we have wisdom. John explained the wrong way of doing things. There are several machine-learning apps for smartphones to check for melanoma. Take a photo of your suspected mole, and the app will determine if it detects skin cancer, and recommend a biopsy. Incentives to sell apps, and to perform biopsies, result in 90 percent false positive rates. There is no financial incentive to improve accuracy.
Sharing is the innovation that converts cheap data into wisdom. Get the world's smartest people to compete to create wisdom. Collaborating with IBM on Dialogue for Reverse Engineering Assessments and Methods [DREAM] platform, a competition for modeling breast cancer was launched. Requiring all participants to share their code in real-time allowed the accuracy of the model to jump three orders of magnitude in just nine days. Over 60 teams participated. The winning team was awarded an article and cover of [Science Translational Medicine] magazine.
John feels that there are very few genius [data scientists] in the world, and they are isolated, hideously overpaid, managing hedge funds or search engines, but would probably rather be looking for cures for cancer.
Progress is not made if every company only has its own people looking at its own data. John wants data to shared amongst the world's scientists to create wisdom. However collaboration flies in the face of the competition that all the reward systems are based on in health care.
As an experiment, John wanted to make his own genome public. However, that requires "informed consent" for others to use his private health information, and it took him six months of legal and ethical rules to develop a system for him to provide this consent for public use.
In much the same way that gardens and fields were the first [commons] shared by farmers, John feels we need to cultivate the public domain, the "digital commons". This can truly transform medicine and health care.
Peter Singer, Technology Expert and Best-selling Author
The first web page appeared in 1991, and now there are over 30 trillion pages. Over 98 percent of military communications occur over civilian internet communications. The [Internet of Things] adds everything from smart cars to medical devices into the equation.
But along with all the benefits the web has brought society, there are also risks. Every second, nine new pieces of malware are discovered. An astounding 97 percent of Fortune 500 have admitted to being hacked. Over 100 governments have established a cybermilitary force.
(Instead of Powerpoint slides, Peter had a slideshow of his personal collection of the world's best and worst cybersecurity art. Studies show that audiences remember 60 percent more if they are looking at pictures when they hear a speaker.)
While IT folks are good at dealing with both hardware and software, they traditionally don't do well with "wetware", the human side of things. Essential cybersecurity terms and concepts are often misunderstood.
Business leaders over-react to some threats, but completely ignore others. Consider that 70 percent of cybersecurity decisions at companies are made by executives who have no training in cybersecurity. No single MBA program offers cybersecurity courses.
There is a shortage of talent to deal with cybersecurity. Hiring managers are only satisfied with 40 percent of the employees they hire in this Cybersecurity space.
Incentives help explain why some industries like financial services do security well, while others like health care do poorly.
In an effort to find which employees do not take cybersecurity seriously enough, Companies have resorted to sending [phishing] emails to their own employees. Those that click are caught, and must attend mandatory training, or are subject to dismissal. Unfortunately, senior executives are twice as likely to click on phishing emails than the general workforce.
Peter recommends companies focus on resilience. You can never build high enough walls to eliminate threats. Instead, focus on bouncing back after attacks, similar to the anti-bodies in the human body deal with illness.
Ben Franklin said that an ounce of prevention is worth a pound of cure. Peter cited a studied that found proper cyberhygiene would have prevented 94 percent of attacks. The most successful foreign military attack on the U.S. military happened when a soldier saw a memory stick in a parking lot, and was curious enough to connect it to the secure military network to see what it contained.
We need to build an ethic. We teach our kids to cover your mouth when you cough. This does not protect your child in any way, but is an ethic to avoid spreading disease. We need to teach the same ethics related to cybersecurity.
All three were excellent talks focused on innovation. Ron Finley used gardening in otherwise empty urban spaces to help grow people as well as food. John Wilbanks used innovation to help bring the smartest minds to determine models for identifying cancer from genomes. Peter Singer marveled at the innovation of the Internet, and how proper cyberhygiene is needed to keep it secure.
These talks were recorded and available on this [98-minute YouTube video]. For those on Twitter, my handle is @az990tony and the hashtag for this session was #ibmedgetalks.
Wrapping up my coverage of the of the [IBM Edge 2013] conference, I have some photos of people I ran into at the Solutions Center.
Leslie Hattig and Lisa Stone, both account managers for [MarkIII Systems], an IBM Business Partner located in Houston, TX. These ladies are inseparable BFFs, I have never seen one without the other! I first met them at the [Storage Symposium in Chicago] back in 2009.
Stacy Tabor was our Community Manager for the [Storage Community]. This community covers IT Storage challenges, hot topics, architecture and solutions. You'll find industry news, videos, blog discussion threads on timely topics, exclusive analyst white papers and experts opinions. I am a frequent contributor, myself, and thank Stacy for her past service. She helped run a "Social Media Hour" at Edge for all the bloggers like me to get to meet each other.
I could not resist getting a picture with this Las Vegas Cirque du Soleil] dancer. This was an invitation-only event, sponsored by IBM Business Partners, that I was invited to during the Social Media Hour. (See, it pays to be social!) I think the visual effects of the flag she was waving turned out really well in the picture! And yes, in case you are wondering, that is my favorite grape-flavored beverage (GFB) in my left hand. Posing for this picture was quite the balancing act, but then I am also a certified yoga instructor, so I was able to manage!
Tanaz Sowdagar is an IBM Storage Rep for our Business Development Team. This includes finding other companies to OEM our technology and re-brand it under their own names. I have worked with Tanaz for many years, helping answer questions that potential OEM parnters have about our products and technologies for this purpose.
This was Michelle, my Conference Room Monitor. Each room had one, scanning the bar-codes on each badge for all the attendees, keeping count of the number of people for each session, supporting anything the speaker needs, like getting the A/V guy to come help set up the laptop projector.
Since this was Friday, last day of the conference. I decide to dress casually, consistent with many company's [Casual Friday] dress code policy. I am wearing the "IBM Edge Rocks" tee-shirt given out at the concert and Solutions center the first few nights.
Getting this shot right took several takes, as the man I handed my camera to had apparently never seen a digital camera before, did not know how to focus, and some
Finally, leaving Las Vegas, I sat next to Mrs. Joey Clark, wife of "Bulldog" Clark of the Utah band [Blammity Blam]. She also sometimes plays violin with the band. She is a newly-wed, and not sure if Joey is her name, or her husband's name. (Joey, if you are out there, and want me to correctly identify you, please write a comment in the section below.)
What I have learned however, is that if a beautiful girl is sitting next to me on the plane, she will either talk to me the entire flight, implying that she is single, or mention within the first 30 seconds of conversation that she is married. Sadly for me, it was the latter.
(We were both flying on to Dallas, TX, whereupon she was going to visit her parents in Florida, and I was on my way to Sao Paulo, Brazil to get stuck there amongst the protesters in what is now called the [V for Vinegar movement], but I will save that for another blog post!)
Well, that wraps up my coverage of Edge 2013. I am sorry it took so many months to cover all the material, but I did not want to have it go uncovered much longer.
Next year's [Edge 2014] is expected to be bigger and better. It will in Las Vegas again, but this time at the Venetian Hotel, May 19-23, 2014. I plan to be there!
Continuing my coverage of the of the [IBM Edge 2013] conference, I have more photos of people I ran into at the Solutions Center.
Here is Dana Grove, one of our event coordinators from George P. Johnson, or [GPJ], for short. GPJ is the company IBM hires to help us run conferences like this. I met Dana back in 2011 at the Gartner Data Center conference, you might remember her [wearting the white lab coat].
As a former owner of [Tucson Fun and Adventures], I am well aware of the challenges of running events, so I appreciate all the work they do.
Here is Ally Haigh, daughter of my former IBM colleague, Jerry Haigh. Jerry worked in the marketing team for System Storage, but retired from IBM shortly after this event.
Janet Wong, a Client Technical Specialist for IBM Disk Systems. She works in Techline up in Calgara, Canada, and provides pre-sales supports such as running modeling tools to help clients configure the optimal disk system for their workloads. I love going up to Calgary in the summer, to escape the Tucson heat. One of these days, I will try to line up with their famous [Stampede], touted as one of the greatest outdoor shows on Earth!
Here is Taylor Brown from [Fusion-IO], one of our suppliers for PCiE-based Flash memory cards that we use in IBM servers. Many clients have asked me what will happen to Fusion-IO now that IBM has acquired Texas Memory Systems that also makes PCiE cards that compete directly with them, and all I can say is that I have no idea what the IBM plans are in this area.
Here is Julia Mak, one my many friends over at [OxygenCloud]. The tattoo on her left arm reads: "Do what you love, Love what you do" with little clouds as quotation marks.
OxygenCloudis IBM's official front-end for IBM's SmartCloud Enterprise Object Storage, managed on our behalf by [Nirvanix]. The Tucson Executive Briefing Center where I work is a heavy user of OxygenCloud as a way to distribute materials to our clients. Previously, we would burn CDroms for each attendee containing the various PDF files, but it is SO MUCH EASIER to send a single link to all the materials via OxygenCloud.
The OxygenCloud team is based in San Francisco, and they have invited me to visit their office the next time I visit clients up there!
Update: Recently, Nirvanix announced they are winding down their operations, shuttind down on October 15, under [Chapter 11 bankruptcy] protection. They have designated IBM to help their clients move their data off their systems. I have already taken care of that for my own OxygenCloud accounts we manage here at the Tucson EBC, and working with others to do the same for their accounts.
Continuing my coverage of the of the [IBM Edge 2013] conference, I have some photos of people I ran into at the Solutions Center.
Here is Sarah Hale at the Emulex booth. Emulex is one of our suppliers for host bus adapters (HBAs), headquartered in Costa Mesa, California. There is an ongoing controversy at IT events like this on whether to fly in experts from the home office (in this case, the Emulex home office is not far away) or use [locally available talent]. Some of those working the booth seem to hide their residency, while others are proud of where they live. When I asked Sarah how long she had been working for Emulex, she had the best answer of the week ... "Since 2 O'clock!"
For my readers who complain that I only appear to take pictures with beautiful women at these events, I present a counter-example. Here is Lang Levstek, a good friend of mine from Detroit. Officially, he is an IBM Storage Sales rep across Michigan and Northwest Ohio, and I have flown out to visit his clients several times this year. His wife took the photo and noticed that Lang and I both wear identical wristwatches, a detail we had never noticed before.
Some have asked me how I am able to get so many people to take pictures with me. In this case, these two ladies, Paige Taylor on the left, and Kate Williams on the right, both from [Centerline Digital] yelled "Hey, There's Tony Pearson, let's get a picture with him!" When I was the chief marketing strategist for IBM's System Storage product line, I worked closely with the team at Centerline Digital to develop marketing collateral. I will be going to Raleigh, NC in a few weeks, so I may just have to stop by to visit their new location!
The folks over at Bridgeworks in United Kingdom have developed an awesome storage protocol accelerator called [SANslide] that helps with remote replication across long distances. Here is April Trinidad, who works for [Agilesys], the Master Distributor of the Americas for SANSlide products. Bridgeworks and Agilesys were on hand to promote the [SANSlide 150V7KSVC] that supports Storwize Family products.
This is Julie Dufour from IBM Worldwide Marketing on the Tivoli Software side of our business. The Tivoli team has been renamed the "Cloud and Smarter Infrastructure" group, so if you see "C&SI" on people's business cards, now you know what that stands for. Julie has been involved with IBM Pulse events. Next year's [IBM Pulse 2014] conference will be held once again at the MGM Grand in Las Vegas, Feb 23-26.
Here is Jennifer Dennis from our Austin facility. I went to school at the University of Texas at Austin, and am often back in Austin to help out the EBC there. Like Tucson, Austin has both hardware and software labs, and Jennifer is from the Software side.
It has been said that all women look both taller and thinner when they take a picture next to me. This tall one is Moran Mazig, a relatively new IBM storage sales rep. She came from Israel and now works in the New York area. You might think she is standing on a box or something, but no, we were standing on level ground. She is literally that much taller than me. This is not an illusion!
Here is Joanne Blais from IBM's Corporate Headquarters. I have only been to HQ once in my career, back when I was chief marketing strategist, filling in for the VP of Storage to present our numbers to Corporate Marketing leadership.
Here is Kelly Groff, from IBM's recent acquisition of Texas Memory Systems. She was there working the booth to help answer questions about IBM's FlashSystems line of all-Flash arrays. Lurking in the background is my Tucson colleague Ahmed Almoustafa, our Storage Front Lines mission manager.
Here is Jessica Duda, a new storage rep in the Seattle area. I have family living now in Seattle, so I hope to see them the next time I visit clients with Jessica in Washington State.
I have a lot more photos of the event, so I will stop right here and continue with another post tomorrow.
A Brief History of SVC and Storwize Family: What, How and Why?
Fellow IBM Master Inventor [and blogger] Barry Whyte gave an excellent session on the past 10 years of development history for IBM SAN Volume Controller and the rest of the Storwize Family based on its binary code. The SAN Volume Controller represents the start of a movement, what is now called "Software-Defined Storage", with a layer of abstraction that completely hides the differences between different back-end devices. The Storwize family is the most successful Software-defined Storage solution in the IT industry!
IBM Cloud Storage Architectures
IBM Clod Barrera presented an updated version of his "Cloud Storage Architecture" pitch from a technical and strategic viewpoint. From 2011 to 2015, external storage spend is increasing 25 percent for public cloud, and 17 percent for private cloud deployments, and that is not including all of the Do-it-yourselfers like Facebook who build their own storage devices from piece parts.
This year, Clod has expanded his "Cloud Storage Taxonomy" to six different categories:
OLTP/transactional, typically block-based
General purpose storage
Ephemeral storage that exists only while a specific virtual machine (VM) is running
Analytics, which tends to be more sequential than random in I/O pattern
IBM is a platinum sponsor of OpenStack, and is proud to have hundreds of contributors assigned to improve this open source initiative.
IBM Linear Tape File System - Enterprise Edition
IBM Ed Childers presented the latest announcement on Linear Tape File System [LTFS]. For a quick recap, IBM first introduced LTFS Standard Drive Edition [LTFS-SDE] in April 2010, which allowed workstations attached to single tape drives to use cartridges much like USB memory sticks. Then, IBM introduced LTFS Library Edition [LTFS-LE] which allows an entire tape library to be mounted as a file system, with each resident tape cartridge listed as a sub-directory.
Now, IBM has LTFS Enterprise Edition, which combines disk-based General Parallel File System [GPFS] with LTFS-LE, resulting in a combined hybrid disk-and-tape file system.
To provide a client's perspective, Konstantin Arnold with Biozentrum, the Life Sciences Research department of the University of Basel, Switzerland and SIB Swiss Institute of Bioinformatics presented some shocking information on their data growth. Biozentrum studies 3D protein folding, with information from the Worldwide Protein Data Bank [PDB] and [UniProt], which combines protein information from Swiss-Prot with manually annotations and TrEMBL computationally analyzed and automatically annotated entries.
Combining lab data, proteomics, deep-sequencing, imaging and high-content analysis, their storage requirements has grown exponentially, from less than 50 TB in 2009, to over 350TB in 2013. With the need to have such a large repository of unstructured data, it made sense to use LTFS-EE for this project!
IBMers presented the use of SAN Volume Controller (SVC) in a "stretch cluster" for a production environment at a bank in the Middle East. Before going into the technical details of the solution, they explained the challenges of running a bank under Sharia law. For example, Sharia law does not allow charging interest rates on borrowed money, but banks can charge fees for services. Debit cards are automatically denied at shops that are "black-listed" such as liquor stores, that are not consistent with the precepts of the Islamic religion.
The SVC implementation was rather straight-forward. IBM has offered Stretch Cluster since 2009 with version 5.1, but it only gained popularity years later when VMware pointed out that this can be used for datacenter to datacenter vMotion activity. The IBM team tested this out with a short 500 meter distance locally, before stretching it out to two locations now implemented. They have three SVC nodes managing 60TB of managed disk capacity at each data center, made up from a mix of DS8870, Storwize V7000 and DS3950 disk systems.
To demonstrate the robustness of the solution, the client requested that the IBM team demonstrate various recovery scenarios while running live in production mode! As you would expect, IBM SVC successfully handled every one.
IBM Cloud Storage with OpenStack and IBM System Storage
IBM Michael Factor presented this overview of OpenStack, and how IBM already supports various aspects of the open source initiative with products like SAN Volume Controller, XIV, and Storwize V7000.
This was the best overview of OpenStack I had heard. IBM is a platinum sponsor of this open source initiative, managed by the [OpenStack Foundation]. In traditional open source fashion, bi-annual releases are given alphabetically-ascending names. The last release was named Folsom, the current release is Grizzly, and the next release planned will be named Havana.
OpenStack is designed to manage your data center or cloud across four capabilities: Compute, Network, Storage and Shared Services. For Compute, the "Nova" project focuses on managing running VM instances, and "Glance" manages VM images that can be launched. The "Networking" project focuses on providing network connectivity. This was formerly called "Quantum", but Quantum (the company) felt there might be some confusion, so it was renamed to just "Networking".
For Storage, there are two projects, "Cinder" and "Swift". Cinder refers to persistent, external block storage, accessible via iSCSI or Fibre Channel. IBM's SAN Volume Controller, XIV and Storwize V7000 already support the Cinder API interface. Swift is focused on "object storage", which can provide an alternative way of storing information for cloud-based applications. SNIA's Cloud Data Management Interface (CDMI) is working with OpenStack to bring object storage into the mainstream.
With the Cinder API, applications can create volumes, take snapshots, set quotas, and attach these volumes to VM instances.
I realize there is a big time gap between this post and my last. Where have I been? "Where haven't I been?"... might be the better question! After my week at Edge, I flew from Las Vegas to Sao Paulo, Brazil where various protests delayed my departure, then visited clients in the Midwestern USA, then London to watch a bit of tennis. From there, I flew to Athens, Greece (and yes, more protests!), took some overdue time-off on the beach on various Greek islands, then taught a Storage Top Gun class in Bangalore, India. So, yes, I have been quite busy. I will try to catch up on typing up all my notes from the IBM Edge conference over the next few weeks!
This week I am in Moscow, Russia for today's "Edge Comes to You" event. Although we had over 20 countries represented at the Edge2012 conference in Orlando, Florida earlier this month, IBM realizes that not everyone can travel to the United States. So, IBM has created the "Edge Comes to You" events where a condensed subset of the agenda is presented. Over the next four months, these events are planned in about two dozen other countries.
This is my first time in Russia, and the weather was very nice. With over 11 million people, Moscow is the 6th largest city in the world, and boasts having the largest community of billionaires. With this trip, I have now been to all five of the so-called BRICK countries (Brazil, Russia, India, China and Korea) in the past five years!
The venue was the [Info Space Transtvo Conference Center] not far from the Kremlin. While Barack Obama was making friends with Vladimir Putin this week at the G2012 Summit in Mexico, I was making friends with the lovely ladies at the check-in counter.
If it looks like some of the letters are backwards, that is not an illusion. The Russian language uses the [Cyrillic alphabet]. The backwards N ("И"), backwards R ("Я"), the number 3 ("З), and what looks like the big blue staple logo from Netapp ("П"), are actually all characters in this alphabet.
Having spent eight years in a fraternity during college, I found these not much different from the Greek alphabet. Once you learn how to pronounce each of the 33 characters, you can get by quite nicely in Moscow. I successfully navigated my way through Moscow's famous subway system, and ordered food on restaurant menus.
The conference coordinators were Tatiana Eltekova (left) and Natalia Grebenshchikova (right). Business is booming in Russia, and IBM just opened ten new branch offices throughout the country this month. So these two ladies in the marketing department have been quite busy lately.
I especially liked all the attention to detail. For example, the signage was crisp and clean, and the graphics all matched the Powerpoint charts of each presentation.
Moscow is close to the North pole, similar in latitude as Juneau, Alaska; Edinburgh, Scottland; Copenhagen, Denmark; and Stockholm, Sweden.
As a result, it is daylight for nearly 18 hours a day. The first part of the day, from 8:00am to 4:30pm, was "Technical Edge", a condensed version of the 4.5 day event in Orlando, Florida. I gave three of the five keynote presentations:
Game Change on a Smarter Planet: A New Era in IT, discussing Smarter Computing and Expert-Integrated systems, based on what Rod Adkins presented in Orlando.
A New Approach to Storage, explaining IBM Smarter Storage for Smarter Computing, IBM's new approach to the way storage is designed and deployed for our clients
IBM Watson: How it Works and What it Means for Society Beyond Winning Jeopardy! explaining how IBM Watson technologies are being used in Healthcare and Financial Services, based on what I presented in Orlando.
(Note: I do not speak Russian fluently enough to give a technical presentation, so I did then entire presentation in English, and had real-time translators convert to Russian for me. The audience wore headphones. However, I was able to sprinkly a few Russian phrases, such as "доброе утро", "Я не понимаю по-русский" and "спасибо".)
After the keynote sessions, I was interviewed by a journalist for [Storage News] magazine. The questions covered a variety of topics, from the implications of [Big Data analytics] to the future of storage devices that employ [Phase Change Memory]. I look forward to reading the article when it gets published!
The afternoon had break-out sessions in three separate rooms. Each room hosted seven topics, giving the attendees plenty to choose from for each time slot. I presented one of these break-out sessions, Big Data Cloud Storage Technology Comparison. The title was already printed in all the agendas, so we went with it, but I would have rather called it "Big Data Storage Options". In this session, I explained Hadoop, InfoSphere BigInsights, internal and external storage options.
I spent some time comparing Hadoop File System (HDFS) with IBM's own General Parallel File System (GPFS) which now offers Hadoop interfaces in a Shared-Nothing Cluster (SNC) configuration. IBM GPFS is about twice as fast as HDFS for typical workloads.
At the end of the Technical Edge event, there was a prize draw. Business cards were drawn at random, and three lucky attendees won a complete four-volume set of my book series "Inside System Storage"! Sadly, these got held up in customs, so we provided a "certificate" to redeem them for the books when they arrive to the IBM office.
The second part of the day, from 5:00pm to 8pm, was "Executive Edge", a condensed version of the 2 day event in Orlando, designed for CIOs and IT leaders. Having this event in the evening allowed busy executives to come over after they spend the day in the office. I presented IBM Storage Strategy in the Smarter Computing Era, similar to my presentation in Orlando.
Both events were well-attended. Despite fighting jet lag across 11 time zones, I managed to hang in there for the entire day. I got great feedback and comments from the attendees. I look forward to hearing how the other "Edge Comes to You" events fare in the other countries. I would like to thank Tatiana and Natalia for their excellent work organizing and running this event!
This week, I am in Las Vegas for [Edge 2016], IBM's Premiere IT Infrastructure conference of the year.
Day 4, the last day of the conference, is only a partial day, and many people opted to leave on Wednesday evening, or Thursday morning instead. The breakfast and lunch meals had fewer people than the previous days. Here is my recap of day 4 Thursday breakout sessions.
Building Hyperconverged Infrastructure for Next-Generation Workloads
Supermicro is more than happy to customize these, upgrading the CPU, RAM, disk or networking connectivity as needed. This solution is roughly half the price of Nutanix, and offers a better Next-Business-Day/9am-to-5pm support package .
The last time I was in Las Vegas, I presented this topic at [IBM Interconnect conference]. Back then, I was given only 20 minutes, was placed on the Solutions Expo showroom floor, competing with the noise and traffic of attendees going to lunch.
This time, it was much better, a large room, and a bigger-than-expected audience given that it was scheduled on Thursday morning.
Cloud storage comes in four flavors: persistent, ephemeral, hosted, and reference. The first two I refer to as "Storage for the Computer Cloud" and the latter two I refer to as "Storage as the Storage Cloud".
I also explained the differences between block, file and object access, and why different Cloud storage types use different access methods. I wrapped up the session covering the various storage solutions that IBM offers for all four Cloud Storage types.
IBM Storwize and IBM FlashSystem with VersaStack versus NetApp FlexPod
Norm Patten, part of the IBM Competitive Project Office Storage Team, presented a competitive comparison between VersaStack with IBM storage, versus FlexPod with NetApp storage.
Commodity Solid State Drives (SSD) and Shingled Magnetic Recording [SMR] offer low-cost, high-capacity storage.
However, they have their own set of problems, so IBM is developing software that can be included in IBM Spectrum Accelerate, Spectrum Scale, and Spectrum Virtualize to optimize their utility.
The concept of Log-Structured Array has been around since 1988. The IBM RAMAC Virtual Array back in the 1990s used it. NetApp's Write-Anywhere File System (WAFL) is an implementation of the [Log-Structured File System] general concept.
SALSA combines Log-Structured Array with enhancements borrowed from the IBM FlashSystem design, that I covered in my Monday and Wednesday presentations, to enhance write endurance by as much as 4.6 times!
This was an NDA session, so I cannot blog any of the details.
World-class Flash-optimized Data Reduction and Efficiency with IBM FlashSystem A9000 and A9000R
Tomer Carmeli, IBM Offering Manager for the A9000 and A9000R presented. He presented an overview of these models on Monday, so this session was focused on the data footprint reduction technologies.
Basically, it is a three step process. First, all "standard patterns" are removed. IBM has identified some 260 standard patterns that are 8KB in length, such as all zeros, all ones, or all spaces, and replaces these blocks immediately with a pattern token.
Second, [SHA-1] 20-byte hash codes are computed on 8KB pieces on a rolling 4KB alignment boundary. In other words, if a 64KB block of data is written, bytes 0-to-8KB are hashed an compared to existing hash codes. If no match, then bites 4KB-to-12KB are hashed, and so on. This approach nearly doubles the likelihood of finding duplicates. When a block match is found, the algorithm can replacing them with pointer and reference count.
Third, any unique data that still remains is compressed using Lempel-Ziv algorithm. This is done using the [Intel® QuickAssist]. This co-processor can compress data 20 times faster than software algorithms running on general-purpose x86 processors.
Do you want an estimate of how much "reduction ratio" you may achieve? IBM has developed two estimator tools to help. The first tool is a complete scan for data expected to be dedupe-friendly. It is a slow process, taking 8 hours per TB. This would be ideal for Virtual Desktop Infrastructure or backup copies.
The second tool is the infamous [Comprestimator] that IBM has had for awhile to help estimate compression savings for IBM Spectrum Virtualize storage solutions like SVC, Storwize and FlashSystem V9000. This tool is very fast, looking at only a statistically-valid subset of the data.
The results of both tools are merged, and the result is within five percent accuracy. This allows IBM to offer guidance on which data to place on these new A9000 and A9000R models, as well as offer a "reduction ratio" guarantee.
A client asked me why I bother to attend other sessions, when I probably know most of the material they present. I explained that I can always learn from others. I can honestly say that I learned something new and useful at every session I attended.
This week, I am in Las Vegas for [Edge 2016], IBM's Premiere IT Infrastructure conference of the year. Here is my recap of Day 3 Wednesday.
Become your own Storage Consultant
Gary Graham, IBM Field Technical Specialist for Storage, and Brian Pioreck, IBM Client Technical Specialist for Storage, co-presented this session. This session explained how to use IBM's 30-day free trial of IBM Spectrum Control Storage Insights, a cloud-based services offering.
(Note: 15 years ago, I was the chief architect of version 1 of what we now call IBM Spectrum Control. I am pleased to see how well this product has evolved over the years.)
Storage Insights provides a reporting-only subset of the popular IBM Spectrum Control Standard and Advanced editions. It reports on IBM storage devices, as well as any non-IBM devices that are virtualized behind IBM Spectrum Virtualize products like SAN Volume Controller (SVC), Storwize, and FlashSystem V9000.
If you are a storage administrator, consider trying this out for 30 days, get some immediate results. Since it is cloud-based, you only need a Windows, Linux or AIX system to install a "collector" on site. This collector sends data up to the Cloud at one of IBM SoftLayer facilities. The installation process takes only 30 minutes, and you can download the code from the Internet.
If you find Storage Insights valuable, helping you reclaim some unused space, or provide other insight that saves your company money, consider buying the service, for only 250 US Dollars per 50 TB monitored. If you want more than just monitoring and reporting, consider one of the on-premise solutions like IBM Spectrum Control Standard, or IBM Spectrum Control Advanced edition, which provide provisioning and configuration capabilities as well.
Enhance your Security posture with At-Rest Encryption using the latest IBM Spectrum Virtualize
All of the IBM Spectrum Virtualize products support Data-at-Rest Encryption. For direct-attached storage, the 12Gb SAS controller performs hardware-assisted encryption.
For SAN-attached storage via FCP, FCoE or iSCSI back-end devices, IBM uses the [AES-NI instruction set] that comes included in certain Intel CPU processors.
Last November 2015, [IBM acquired Cleversafe] for $1.3 Billion US dollars because Cleversafe has the brand name recognition as the #1 Object Storage vendor the past two years in a row (2014 and 2015). On July 1 of this year, the transformation was complete, and their flagship product was officially renamed to the IBM Cloud Object Storage System, which some abbreviate informally as IBM COS.
Since then, IBM has been busy integrating IBM COS into the rest of the storage portfolio. I explained how IBM COS can be used for all kinds of static-and-stable data, but not suited for frequently changed data, such as Virtual machines or Databases.
Object storage can be access via NFS or SMB NAS-protocols using a gateway product, like IBM Spectrum Scale, or those from third-party partners like Ctera, Avere, Nasuni or Panzura. It can also be used as an alternative to tape for backup copies, and is already supported by the major backup software like IBM Spectrum Protect, Commvault Simpana, or Veritas NetBackup.
A few years ago, I explained to a client that Converged and Hyperconverged were like a pendulum swinging back. Over the past few decades, we have gone from internal disk, to externally attached disk, to SAN and LAN networks.
Each time, we gained more flexibility, greater connectivity and longer distances. Then I explained that Converged and Hyperconverged is like going backwards, the pendulum swinging back to the days of internal and direct-attached storage. The analogy was a hit, and thus this session was born!
IBM offers multiple Converged Systems. IBM PureSystems, PureData, PurePower and PureApplication solutions offer racks of compute, storage and network gear. Last year, IBM collaborated with Cisco to create VersaStack, a converged system that combines Cisco's x86 blade servers and switches with IBM FlashSystem and Storwize products.
IBM also offers Hyperconverged solutions. IBM Spectrum Accelerate allows the compute, storage and network functions run on 3 to 15 VMware ESXi hosts to form a cluster. The cluster can then make iSCSI-based volumes available to other virtual machines running on these same hosts. The volumes can also be made available to servers outside the cluster, such as bare metal servers or other Hypervisors. This is available as software-only, or you can get pre-built system called the Supermicro Hyperconvergence Appliance.
IBM Spectrum Scale provides a clustered file system that allows the compute, storage and network functions to run on 3 to 16,000 machines. Formerly called General Parallel File System (GPFS), IBM Spectrum Scale has been around for over 18 years. Over 200 of the world's largest "Top 500" supercomputers run IBM Spectrum Scale today.
IBM Spectrum Virtualize and IBM Storwize Birds-of-a-Feather
Barry Whyte, fellow blogger and IBM Master Inventor, presented an overview of the latest features, and where IBM is headed in 2017 for the IBM Spectrum Virtualize family of products. Barry now works in Advanced Technical Skills for Storage Virtualization Asia/Pacific Region.
The group then moved to another room offering delicious food and drink, as Eric Stouffer, IBM Director, Storwize Offering Manager and Business Line Exec, presented the future areas that IBM is consider for this product family.
All of this was done under Non-Disclosure Agreements (NDA), preventing me from blogging any details. Back in 2003, Las Vegas started a marketing campaign ["What Happens in Vegas, Stays in Vegas"]. Coincidentally, this is the same year IBM introduced the IBM SAN Volume Controller, the first product in the IBM Spectrum Virtualize family.
This was a long day, but was pleased with the large audiences I had at my sessions.
This week, I am in Las Vegas for [Edge 2016], IBM's Premiere IT Infrastructure conference of the year. Here is my recap of breakout sessions on Day 2.
Introducing IBM FlashSystem A9000 and A9000R: Grid Architecture Designed for the Hybrid Cloud
Tomer Carmeli, IBM Offering Manager for the A9000 and A9000R presented. Both models offer data-at-rest encryption, snapshots, remote mirroring, and data footprint reduction, assuming 5.26:1, a combination of pattern removal, data deduplication and hardware-assisted Real-time compression.
The A9000 is an 8U high pod that can fit into existing racks. It comes in 60TB, 150TB and 300TB effective capacity.
The A9000R includes its own 42U rack. The rack is organized as two to six "grid elements" combined with two InfiniBand switches. Grid elements come in 150TB and 300TB effective capacities, giving you up to a whopping 1.8 PB in a single rack!
Similar to the IBM XIV and IBM Spectrum Accelerate offerings, the A9000 and A9000R support Hyper-Scale features. Hyper-Scale Manager lets you manage up to 144 devices on a single pane of glass. Hyper-Scale Mobility lets you move volumes (LUNs) non-disruptively from one device to another.
Different data compresses or dedupes at different ratios. Your mileage may vary. Unless you are evaluating a JBOF (just a bunch of flash) device, there is a great difference between raw, usable, and effective capacity. Raw capacity can be calculated by the size of each chip, times the number of chips. Usable capacity factors out RAID, and any spare capacity set aside for RAID rebuild and garbage collection. Effective capacity indicates the amount of information that can be stored by taking advantage of data footprint reduction technologies, such as compression or data deduplication.
IBM offers three options:
Measured Estimate -- IBM has a set of data reduction estimator tools that can scan your existing data, and estimate your reduction ratio, within 5 percent accuracy.
Competitive Match -- If a competitor had run their own set of estimator tools, IBM might be able to match the reduction ratio, without repeating the analysis, by just reviewing the competitor results.
"Sight unseen" -- without analyzing your actual data, reduction ratio is determine by the type of data (DB2, Oracle, SQL server, etc.), based on experience with similar data at other data centers.
Both A9000 and A9000R models are published at 250 microsecond latency, about 30 times faster than traditional spinning disk, although some workloads actually can run even faster than that. Assuming 5.26:1 reduction, these sell for about $1.50 per effective GB.
Flash Primer - Ready to move from disk storage?
Patricia Crowell, IBM Worldwide FlashSystem Enablement manager, presented. She presented an interesting time line:
First Solid-State Drive (SSD)
First Flash card, such as for digital cameras
First USB stick
Flash used in specialized IT appliances
Flash for the enterprise - Microsoft and UCSD paper on SSD
In 2012, Microsoft Research and University of California San Diego published ["The Bleak Future of NAND Flash Memory"], 8 pages, by Laura M. Grupp, John D. Davis, and Steven Swanson. Here is an excerpt:
"The technology trends we have described put SSDs in an unusual position for a cutting-edge technology: SSDs will continue to improve by some metrics (notably density and cost per bit), but everything else about them is poised to get worse. This makes the future of SSDs cloudy: While the growing capacity of SSDs and high IOP rates will make them attractive in many applications, the reduction in performance that is necessary to increase capacity while keeping costs in check may make it difficult for SSDs to scale as a viable technology for some applications"
IBM disagreed with this bleak assessment, announced it was investing $1 billion US Dollars into this technology, acquired Texas Memory Systems, and has deployed flash throughout its product line. For the past three years, IBM has been the #1 vendor for Flash storage systems.
Patricia offered the following example. What would it take to run 20 million IOPS? Here's a comparison:
Disk systems 15K rpm
Disk systems 7200 rpm
How to migrate from SONAS to IBM Spectrum Scale/ESS using Active File Manager
Paul Schena, IBM Senior IT Specialist, presented his experiences migrating existing SONAS data to new IBM Spectrum Scale or Elastic Storage Server (ESS) deployments. SONAS is going End-of-Service (EOS) on April 30, 2018, so it is never too soon to start this migration.
Paul gave two different methodologies. The first used Active File Management (AFM):
Setup an IBM Spectrum Scale "Gateway Node" in "Independent-Writer" AFM mode. Paul recommends 10 threads per gateway node.
Issue an AFM pre-fetch, disabling the "cache eviction" feature to ensure data remains. AFM transfers the directory structure, file data including sparse files, Access Control Lists (ACL), extended attributes.
Define your exports with no-root-squash and move your user mounts to the new systems
Once all the data is moved, convert the cache filesets to regular filesets
Define your quotas, export settings, ILM policies and rules
Decommision the SONAS
The second used Robocopy and Rsync, which may be required if there is high-latency, long-distance connection that prevents proper AFM connections:
Configure IBM Spectrum Scale CES servers to appropriate NFS and/or SMB protocols
Use Robocopy and/or Rsync as appropriate to move the data to the new system
Decommision the SONAS
Having it all: Hybrid Cloud Storage Services for Block, Power and Backup
Clint Parish, Director of Enterprise Solutions and Services for VSS, and Marc The'berge, Business Development for Supermicro, co-presented this session.
VSS offers POWER8-based Cloud services. They consider themselves "boutique" with POWER8 servers, able to run AIX, IBM i and Linux on POWER applications, but not at the scale and size of larger x86-based clouds like Amazon Web Services or Microsoft Azure.
For IBM i, they attach to IBM Storwize V7000. For AIX and Linux on POWER, they use IBM Storwize V7000 and/or Supermicro Hyperconverged Appliance, a pre-built system based on IBM Spectrum Accelerate.
Supermicro offers three "tee-shirt sizes", their small systems have six nodes, medium with 9 nodes, and large with 15 nodes. Unlike other Hyperconverged systems, the ones from Supermicro include a rack, and are pre-cabled with all the necessary Ethernet switches necessary to make a complete solution.
To offer backup services, VSS uses IBM Spectrum Protect with the Supermicro appliances.
In the evening, we were treated with a concert with Train, known for songs like "Meet Virginia", "Hey Soul Sister", "Calling all Angels" and "Drops of Jupiter". They played all of these, plus covered some songs by Led Zeppelin, Journey, Queen and Aerosmith,