This blog is for the open exchange of ideas relating to IBM Systems, storage and storage networking hardware, software and services.
(Short URL for this blog: ibm.co/Pearson )
Tony Pearson is a Master Inventor, Senior IT Architect and Event Content Manager for [IBM Systems for IBM Systems Technical University] events. With over 30 years with IBM Systems, Tony is frequent traveler, speaking to clients at events throughout the world.
Lloyd Dean is an IBM Senior Certified Executive IT Architect in Infrastructure Architecture. Lloyd has held numerous senior technical roles at IBM during his 19 plus years at IBM. Lloyd most recently has been leading efforts across the Communication/CSI Market as a senior Storage Solution Architect/CTS covering the Kansas City territory. In prior years Lloyd supported the industry accounts as a Storage Solution architect and prior to that as a Storage Software Solutions specialist during his time in the ATS organization.
Lloyd currently supports North America storage sales teams in his Storage Software Solution Architecture SME role in the Washington Systems Center team. His current focus is with IBM Cloud Private and he will be delivering and supporting sessions at Think2019, and Storage Technical University on the Value of IBM storage in this high value IBM solution a part of the IBM Cloud strategy. Lloyd maintains a Subject Matter Expert status across the IBM Spectrum Storage Software solutions. You can follow Lloyd on Twitter @ldean0558 and LinkedIn Lloyd Dean.
Tony Pearson's books are available on Lulu.com! Order your copies today!
Safe Harbor Statement: The information on IBM products is intended to outline IBM's general product direction and it should not be relied on in making a purchasing decision. The information on the new products is for informational purposes only and may not be incorporated into any contract. The information on IBM products is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. The development, release, and timing of any features or functionality described for IBM products remains at IBM's sole discretion.
Tony Pearson is a an active participant in local, regional, and industry-specific interests, and does not receive any special payments to mention them on this blog.
Tony Pearson receives part of the revenue proceeds from sales of books he has authored listed in the side panel.
Tony Pearson is not a medical doctor, and this blog does not reference any IBM product or service that is intended for use in the diagnosis, treatment, cure, prevention or monitoring of a disease or medical condition, unless otherwise specified on individual posts.
The developerWorks Connections Platform is now in read-only mode and content is only available for viewing. No new wiki pages, posts, or messages may be added. Please see our FAQ for more information. The developerWorks Connections platform will officially shut down on March 31, 2020 and content will no longer be available. More details available on our FAQ. (Read in Japanese.)
The latest IBM Systems Journal has [fifteen articles about IBM Service Management], which includes the disciplines for managing storage resources as part of an overall IT data center.As with most journals, these articles are heavy academic efforts, not light summer reading.
However, since I have moved from marketing to consulting, I need to read these kinds of articles to keep up with the industry. I realize many people don't have time to read allof these, so over the next three days, I will give some quick highlights in hopefully more understandablelanguage. Here is what I got out of the first five articles:
An Overview of IBM Service Management
This 10-page article provides a good overview of what the other articles go into greater detail.The role of information has changed, from supporting back-office tasks like payroll andinventory, to enabling growth in the business itself, providing insight and competitive advantage. The challenges are summarized under "Four C's": Complexity, Change, Cost, and Compliance. The recommended approach is to engage with IBM,who has thousands of practitioners with years of experience in ITIL, eTOM, COBIT, CMMI and SOA.
Adding value to the IT organization with the Component Business Model
Many Service Level Agreements (SLAs) are loaded with technological jargon rather than concentratingon intended business results. CIOs must change this, and learn to run IT as a business witha service delivery focus.IBM Process Reference Model for IT (PRM-IT) is the foundationfor the Component Business Model for the Business of IT (CBMBoIT) that can assist with strategic decision making to transform IT into this new role.
An Integration model for organizing IT service management
There are so many ways to implement Information Technology Service Management (ITSM) that it is hard to tell if there are gaps or overlaps between products and offerings. A seamless solution requires common terminology and approaches. An integration model helps to bring all this together, focusedon being consistent with existing practice, with clarity of expression, and practical to implement.
IBM Service Management architecture
Today's systems management tools are fragmented by resource domain--servers are managed here, networksmanaged there, and storage is another story altogether. IBM Service Management intends to integratea portal-based User Interface, a process runtime layer, a configuration management database (CMDB), and all the various operational management products (OMPs) for each resource. For example, IBM TotalStorage ProductivityCenter is an OMP for IBM and non-IBM storage resources.
A configuration management database architecture in support of IBM Service Management
IBM Tivoli Change and Configuration Management Database (CCMDB) holds all the configuration data of IT resources in the data center, including individual "configuration items" (CIs), as well as tracks changes. The database is populated with data from different sources, includingautomatic discovery. Relationships between CIs provides a visual representation of application dependencies.The data model uses a clever combination of Unified Modeling Language (UML) with Java persistent objects.
This week I am in Maryland, teaching at our Top Gun sales training class.
Of course, often it is the students teaching me something new. Bringing up freshnew ways at looking at things.
Take for example this new online video game called Capacity Crisis. In it, you are the storage administrator tryingto get additional storage capacity to all the different departmentmanagers that need more space.
My how time flies! It has been nearly a year since our new Tucson Executive Briefing Center had its [Ribbon Cutting Ceremony].
To celebrate this achievement, IBM asked me to write and direct a short film to remind everyone we are here to help clients solve problems, determine an appropriate strategy and make solid purchase decisions.
I have produced other videos for IBM. See my October 2013 blog post [Incorporating Videos] for other examples. This was my first time as writer/director for a project.
This video won't win any Oscars, but I would still like to thank the Academy, my colleagues IBM VP Calline Sanchez, Lee Olguin, Joe Hayward and Kris Keller agreeing to be filmed on camera. Behind the scenes, I want to thank IBM Fellow John Cohn for his superb narration, Andrew Greenfield as cinematographer and editor, Shelly Jost as creative consultant selecting the musical tracks, and Denise White for reviewing the screenplay. Finally, I want to thank our producer, Bill Terry, for funding this effort.
What do you think? Will it go viral? Enter your comments below!
The [IBM Edge2015 conference] is premiere conference covering Infrastructure Innovations for IBM System Storage, as well as sessions about z Systems and POWER Systems from our IBM Enterprise conference. Check out this short two-minute [YouTube video on IBM Edge2015].
Doug Brown, IBM Vice President of Marketing, kicked off the second general session. Here is my quick recap of the general session on the second day, Tuesday, May 12, 2015.
IBM Corporate Strategy
Ken Keverian is IBM Senior Vice President Corporate Strategy. He feels that when they write the history of IT industry of the past 100 years, the key innovations were the transistor, the Internet, and analytics. (IBM was involved in all three!)
IBM organizes all of its strategies in three segments. Ken presented the three pillars of IBM's corporate strategy. The first pillar is the set of IBM strategic imperatives: Data, Cloud and Engagement. Engagement includes Mobile, Social and Security concerns.
The second pillar is the effort and expertise needed to connect these new strategic imperatives together with existing traditional workloads. Hybrid Cloud is a good example of this, linking together traditional IT or on-premise private Clouds with off-premise offerings. IBM is committed to open standards to make this happen.
The third pillar is moving up the value chain. Some 30 years ago, IBM relied heavily on its hardware business that represented as much as 85 percent of its total revenues. Today, IBM continues with Software, Services and Systems as its core foundation. However, a new portion of IBM will focus on delivering deep industry offerings and expertise, automation of services, and insights-as-a-service.
Client Testimonial from Walmart
Rich Jackson, Senior Technical Expert at Walmart, presented his client testimonial. He started with the following quote:
"There is only one boss. The customer. And he can fire everyone from the chairman on down, simply by spending his money somewhere else."
-- Sam Walton
Walmart is one of one of the largest retailers in the world, with over 11,000 stores across 27 countries, generating over $480 Billion US dollars in revenue last year. But Walmart is not just large from putting big stores in small towns, but by shifting from inventory to information.
As with many retailers, the last two months of the year, November 1 to December 31, represent a huge spike in holiday sales for Walmart. Cyber Monday in 2014 resulted in 1.5 billion page views online. About 70 percent of the online sales are from mobile devices. Walmart has trusted its business to the robust scalability and reliability of IBM z System mainframe servers and storage.
Analytics in Healthcare
Inhi Suh is IBM Vice President of Strategy for IBM Analytics. She presented the use of IBM Streams computing in hospitals to help deal with all the alerts and beeping sounds that nurses and technicians just can't act upon.
Thanks to IBM technology, the data of an incoming patient can be retrieved to the hospital before the patient does. Doctors can also access the data, to let the nurses and technicians start on things before the doctor arrives to the hospital.
Dr. Gustavo Stolovitzky is IBM Program Director for Translational Systems Biology and Nanobiotechnology. He explained the challenges of breaking down the silos by using the "wisdom of crowds". IBM launched "Dream Challenges" to see if crowd-sourcing can help with medical challenges. The result, two very accurate algorithms to predict the progression for ALS. These two algorithms were more accurate than 12 ALS medical experts!
Scott McGill is President and CEO of Coriell Life Sciences. He explained that deaths from drug interactions now causes more deaths than automobile accidents. Their product is called GeneDose Live, which uses genomics and DNA science to help doctors determine if this pill is right for that patient, and whether a cocktail of medicines will work together, or against each other. This tool can help doctors swap out different medicines to reduce risk and increase effectiveness for individual patients.
IBM Research projects
Arvind Krishna is IBM Senior Vice President and Director of Research. When it comes to medical data about a patient, only 10 percent is in the medical records. Another 30 percent is your genetics and family history. The last 60 percent is your lifestyle, what countries you have visited, and what foods you have eaten.
Analytics can also be used in the food supply chain to increase food safety. This can help reduce forborne illnesses which affects 1 out of 6 people every year, resulting in over $80 billion dollars in lost productivity. Analytics can also help food growers to reduce water usage and increase crop yields.
By the end of this decade, IBM plans to have "Exascale" systems that can have ExaFLOP of compute capability connected to an Exabyte of data. Your brain can do amazing things with just 50 Watts of energy, but supercomputers consume 50 Megawatts!
IBM has developed "Cognitive Computing" chips that emulate thousands of neurons and millions of synapses. It can be "trained" to perform certain functions with just 200 miliwatts of power. By combining these chips into boards and racks, IBM can amass a large cognitive computing environment to give Watson the ability to reason.
Lastly, Arvind covered IBM's advancements in Quantum Computing. They were able to successfully combine 4 Quantum Bit circuits (QuBits) together. IBM estimates that just 50 QuBits would outperform any combination of supercomputers from the TOP500 list.
IBM's innovations can be applied not just to Retail and Healthcare, but a variety of other industries as well!
The [IBM Edge2015 conference] is premiere conference covering Infrastructure Innovations for IBM System Storage, as well as sessions about z Systems and POWER Systems from our IBM Enterprise conference. Check out this short two-minute [YouTube video on IBM Edge2015].
Here is my quick recap of my sessions on the first day, Monday, May 11, 2015.
Solution Center Setup and Training
IBM hires [George P. Johnson Experience Marketing], or GPJ for short, to help with its events. I was asked to be on-hand for the Monday morning training in case I was needed to fill in for anyone else during the lunch hours and evening receptions.
There were quite a lot of demos. We had SAN Volume Controller, Spectrum Accelerate and Spectrum Scale at various booths. There were also plenty for POWER and z Systems as well. I cover a wide variety of these topics, so am often used as the "universal substitute" in case some needs to take a break, or just gets caught up in a one-on-one discussion with an attendee.
It didn't help that while we are trying to listen to the GPJ ladies on how to scan barcodes on attendee badges and use the interactive kiosks, large machinery is placing the demo hardware in place.
Here a forklift operator is putting a VersaStack converged system that has a mix of Cisco UCS, NEXUS and MDS hardware with IBM Storwize V7000 Unified storage.
I presented as session explaining why our clients are excited about Software Defined Environments, including an overview of IBM's Software Defined Storage offers in the IBM Spectrum Storage™ family of products, and how to get started.
According to IDC, an independent IT analyst firm, IBM has over 40 percent marketshare in Software Defined Storage, ranking IBM #1 in this market.
Not surprisingly, this was by far my most attended session for the week, and I presented twice to fully packed rooms.
IBM is ranked #2 in Cloud Storage. This session covered the different types of Cloud storage, including persistent, ephemeral, hosted and reference storage categories. I covered the advantages of block, file and object level access.
Lastly, I covered the various IBM products for each type. For block-level transactional storage, I covered IBM XIV Storage, XIV Cloud Storage for Service Providers, Spectrum Accelerate software and the Storage Hypervisors built with Spectrum Virtualize such as SAN Volume Controller (SVC) and the rest of the Storwize family, and FlashSystem family products.
For file and object level storage, I covered Spectrum Scale software, including Elastic Storage Server and Storwize V7000 Unified pre-built systems. I also included how these fit into a file sync-and-share deployment using IBM partnership with OwnCloud or Funambol.
Finally, I mentioned the Cloud storage offerings from IBM SoftLayer and IBM Cloud Managed Services.
Data Footprint Reduction - Understanding IBM Storage Efficiency Options
I have presented this topic now for several years, but never fails to draw an audience.
I start with the basics of Thin Provisioning, explaining the difference between coarse-grained and fine-grained designs, and how these are employed in IBM DS8000 disk system, XIV Storage system, SVC and Storwize family products, DCS3700 and DCS3860 disk systems.
I then covered Space-efficient Snapshots, including IBM FlashCopy. These can be used with either fully-allocated or thin-provisioned source volumes, and can substantially reduce the amount of storage needed to keep immediate copies.
Next I covered Data Deduplication, including IBM ProtecTIER family of products, Spectrum Protect software, and IBM's partnership with Atlantis ILIO for IBM FlashSystem for Virtual Desktop Infrastructure (VDI) deployments.
Lastly, I covered Compression, explaining the unique advantages of IBM's Real-time Compression compared to the performance-degrading methods used by our competitors. IBM Real-time Compression provides better capacity savings than Data Deduplication for 95 percent of your active data workloads, and is available on FlashSystem V9000, SAN Volume Controller, Storwize V7000 and this week IBM announced it available on the XIV Storage systems as well!
As you can imagine, I get invited to a lot of client dinners during the week. For Monday evening, I managed to combine two clients into a single dinner! The two clients were from completely different industries, but from the same part of the country. Everyone all got along, so it worked out very well.
Tuesday (Day 2) of the [IBM Edge 2013] conference once again started with live music from the rock band [Delta Rae]. I had the pleasure to meet one of the lead singers, Liz Hopkins, before their set! In the picture on the right, she is the brunette in the middle.
(FTC Disclosure: I work for IBM, and not for Sprint, Wellpoint or any other company mentioned on this blog post. I was not paid by any other company to mention their company, products or services. I have used Sprint in the past for my cellphone service, and I can say they are a great company from end user experience. As part of my job at IBM, I was a technical advocate for Wellpoint from 2009 to 2011 as they deployed their IBM Watson-based solution. I am an extended member of Jeff Jonas' G2 team.)
Here is a quick summary of the general sessions on Day 2:
Tom Rosamilla, IBM Senior VP of Systems and Technolgoy Group, Integrated Supply Chain
I have known Tom for a long time, since the 1990s when we both attended [SHARE user group] conferences, and he recently took over as Senior VP of our group. He started his talk about the innovative uses of "big data" analytics. For example, retailers can tell which shoppers are pregnant six months before birth of their child, based entirely on changes in shopping patterns, and can then send out "Hey, you're having a baby!" promotions targeted specifically to them.
Instead of the [Spray-and-Prey] of traditional direct-mail advertising that targets demographics based on broad categories of gender, race or income brackets, big data analytics allows our clients to get down to a "Demographic of One".
This is all part of IBM's "Smarter Planet" campaign that it launched five years ago. IBM has 3,000 research scientists (full disclosure: I was one, myself, before I switched over to development), investing over $6 billion USD per year, half of which is invested for our Systems and Technology Group that developers servers and storage hardware (or as we like to call it internally, the "M" in IBM). Here are some of the recent investments:
$1 Billion USD in Flash technology, including the acquisition of Texas Memory Systems
$800 Million USD in the development of eX5 for the System x server line
$2 Billion USD for PureSystems, including Flex System, PureFlex, PureApplication and PureData models. IBM has sold more than 4,000 PureSystems in 90 countries
$4 Billion USD for Power7 and Power7+ processors and the Power Systems that are based on them, which has helped IBM complete 3,400 displacements of competitive UNIX servers.
$1 Billion USD for zEC12, the latest System zEnterprise mainframe. Across all server types, IBM is #1 in worldwide server share, but the recent surge in mainframe sales certainly helps. Of the top 100 banks in the world, 96 run their mission critical applications on System z mainframes.
$10 Billion USD in acquisitions since 2010 (20 last year, 160 in last 12 years), including
SoftLayer Cloud, Kenexa Human Capital, Worklight mobile app development, Netezza analytics
IBM is also getting serious about being a "Social" business, and is already #1 in Enterprise Social Software. (This blog runs on IBM Connections, which is available to our clients as well for their social efforts).
The right infrastructure is required for innovation. Corporate cultural change is also required. Transformation is the new business imperative
Karim Abdullah, Director IT Operations at Sprint
What I like about Edge is that instead of listening to one IBM executive after another, IBM invites key reference clients to provide their testimonials.
Over 71 percent of CIOs at leading companies are trying to figure out how to best take advantage of new technologies to improve their customer experience. [Sprint] is one of them, ranking #3 telecom in the United States.
Flash is a Game Changer. Leveraging technology of IBM Flash allowed Sprint to achieve 45 times improvement in performance of targeted queries for the call centers. Not only has it helped increase performance at Sprint, but also to reduce energy, floorspace, power & cooling costs.
Dr. Samuel R. Nussbaum, M.D., Executive VP Clinical Health Policy, Chief Medical Officer, Wellpoint
[Wellpoint] is the largest health benefits company in the United States, with 36 million patients, and 600,000 physicians and medical specialists in its network.
Dr. Nussbaum spoke about the power of information. Citing a famous quote from Charles Dickens, he feels we are in the best of times, and the worst of times, when it comes to healthcare. On the best of times, we have genomics research that helps cure disease, and a variety of other science and technology breakthroughs.
On the worst of times, the industry is not without its own set of problems. Why are there such huge variations in healthcare, expenses and quality? We get the right care only 55% of the time. Part of the problem is that our reimbursement systems which focus on volumes, not outcomes. Wellpoint is working to fix this.
Dr. Nussbaum shared some shocking statistics:
$2.6 Billion USD is spent on Healthcare in USA, one third of this is wasteful and unnecessary
20 percent of patients are re-hospitalized within 30 days
From 2002 to 2010, annual U.S. household income grew only 7 percent, from $49,000 to only $52,000 per year, but medical expenses nearly doubled in the same timeframe, from $9,235 to $18,074 per year.
It's not enough to just spend nearly $100 Billion USD in public and private reserach in healthcare to get innovation, you have to put them to good use. Why did it take so long to put wheels on luggage for airplanes? It took six thousand years, from the invention of the wheel, to putting them on luggage.
Part of the challenge is that there is too much information, not enough time. Medical information doubles every 5 years. There are more than 21 million articles in [PubMed/MEDLINE], with 1 million being added every year. Only 12 percent of physicians' time is spent with patients and examinations, while 80 hours per week are spent with payors and administrators. For pre-authorizations for certain medical procedures or tests, 66 percent of physicians experience delay in pre-certifications.
Computer Science has evolved, from tabulation on punched cards, to programmatic logic, to new forms of [Cognitive Computing]. The Watson computer thinks like a physician does, and can understand natural language. Wellpoint's Anthem Watson Application can analyze the entire "Longitudinal Patient Record" of payors, labs, hospital EMR, physical office EMR, and Imaging. Watson crunches all this information available to recommend treatment options, dLiz Hopkinsecision support for oncology, and evidence-based care through pre-authorization.
Wellpoint is working with [Memorial Sloan-Kettering] to focus Watson-based efforts on cancer, based on analysis leverage 1.5 million patient records. More than 1500 people die of cancer every day. Wellpoint and Memorial Sloan-Kettering are going after 22 different cancers, including lung cancer and breast cancer.
Bernie Meyerson, IBM Fellow and VP of Innovation
Many people felt that Bernie did not get enough time to speak on Monday, so he is back today for a second topic! He started with a quote:
"Cyber Security threat facing America is a pre-9/11 moment. We know foreign cyber actors are probing America's critical infrastructure networks."
--- Leon Panetta, U.S. Secretary of Defense
Bernie gave examples how cyber-terrorists can easily bring down the US government and its financial system. In a recent analysis, more than 50% of software was found to have "back doors". Recent attacks show the extent of the problem:
A perimeter defense is not enough. Thus, the primary weapon to fight these threats is Real-time data analytics. IBM has four specific platforms: Cyber Security Platform, Insider Threat Platform, Mobile Secuirty Analytics, and Cloud Security Analytics. These allow security teams to see threats "visually".
Various parts of IBM are focused on security issues. IBM Research, Security Systems, X-force, and IBM Security Services are constantly innovating because the bad guys are innovating too! IBM's Watson vast cognitive computing is being put to work to help address security issues.
Innovation is transforming IT. If your laptop did not benefit from [Moore's Law], the computing capability would weigh quarter of a million tons! Of course, some people fear the worst. Bernie cited HAL in the movie ["2001: A Space Odyssey"] and SkyNet in ["The Terminator"] anthology.
IBM recently launched [MobileFirst], to bring together all aspects of mobile computing, including smartphones and tablets. In some countries, your mobile phone is your only connection to your bank, your internet, your friends and families. Unfortunately, there are a few malicious apps readily available for download from respective "app stores" for each device.
Jeff Jonas (IBM Fellow, Chief Scientist, Entity Analytics) and David Baker (Pew Charitable Trust, Director of Election Initiatives at Pew)
David started out with a funny analogy. A government employee suggested that elections should be as simple as getting your oil change at [Jiffy Lube]. Think about it, changing your car's oil used to be quite a hassle, and now you can drive in, and have your oil changed in 15 minutes or so.
David's response was that elections are already like oil changes, if everyone got their oil change only once every four years, and all got them on the same day, at buildings that have never been designed for oil changes, by people who have never seen the underside of a car, being paid less than minimum wage.
Jiffy Lube performs oil changes every day. Elections, on the other hand, are on a 48 month cycle, with little to no activity for 47 months, then for one month they have Black Friday-meets-Day-after-Christmas times ten.
One of the biggest factors to the problems of elections are the voter lists. Here are some astonishing facts about U.S. elections:
12.7 out-of-date records at any given moment, mostly because Americans are quite mobile. One out of eight Americans moved between the 2008 and 2010 elections. One out of four among young Americans move every year.
1.8 million deceased listed as voters
2.7 million people are registered in multiple states, often because they update their registration in their new location, but fail to notify their previous state's voter registration.
51 million (1 in 4) not registered to vote
One out of three voters think voter registration is updated automatically when they move
More than 50 percent of voters are unaware that the local Department of Motor Vehicles (DMV) can be used to update voter registration when drivers license information is updated.
Most voter registrations happen within 30 days of election, in paper form. Some states like Michigan process 99.7 percent of voter registrations correctly, but other states like Indiana process only 28.3 percent correctly.
When IBM's Jeff Jonas was invited by Pew to work on a task force on elections, he felt like Jim Carrey in the movie ["Yes Man!"].
Jeff Jonas showed via whiteboading, how to connect voter records that match by some key pieces of information, like birthdate and social security number, by cross-referencing voter registration lists with information from each state's DMV.
Technology is "G2", analyzing the observation space like "puzzle pieces" as a metaphor. Data finds matching data. Relevance finds you.
To address privacy concerns, Jeff added seven key privacy features, including a "Data anonomization" features for date-of-birth, Drivers license number and Social Security number, using a one-way hash that cannot be reversed to get the original number. The information from each state is anonomized before it leaves the state, so it is secure from the very beginning.
To explain the one-way hash, you take a pig through a special grinder and create sausage. Even if a malicious party had access to both the grinder and the sausage, they would not be able to recreate the pig in its original form.
The result is the Electronic Registration Information Center, or [ERIC] for short, which is a collaboration across seven states. ERIC has already identified 5.7 million eligible voters in these seven states. Over 300,000 registered months before deadline, using efficient online methods, now offered in 13 states, and is more cost-effective.
How cost-effective? By comparison, the cost to process a paper voter registration form is about 83 cents, but online processing is only 3 cents. This means huge savings for taxpayers and governments.
The [Edge2013 livestream replays] are still available. If you went to Edge2013, and want to see something again, or if you weren't there, and want to see what you missed, check it out!
Are you covering the business impact of the internet failure across Asia, the Middle East and North Africa? The outage has brought business in those regions to a standstill. This disaster shines a direct spotlight on the vulnerability of technology and serves as a reminder of the ever increasing importance of protecting business critical information.
Disaster recovery needs to be a critical element of every technology plan. We don’t yet know the financial impact of this wide spread internet failure, but the companies with disaster recovery plans in place, were likely able to failover their entire systems to servers based in other regions of the world.
When I first heard of this outage, I am thinking, so a few million people don't have access to FaceBook and YouTube, what's the big deal? We in the U.S.A. are in the middle of a [Hollywood writer's strike] and don't have fresh new television sitcoms to watch! Yahoo News relays the typical government's response:[Egypt asks to stop film, MP3 downloads during Internet outage], presumably so that real business can take priority over what little bandwidth is still operational. Fellow IBM blogger "Turbo" Todd Watson pokes fun at this, in his post[Could Someone Please Get King Tutankhamun On The Phone?].Like us suffering here in America, perhaps our brothers and sisters in Egypt and India may getre-acquainted with the joys of reading books.
However, the [Internet Traffic Report-Asia] shows how this impacted various locations including: Shanghai, Mumbai, Tokyo, Tehran, and Singapore. In some cases, you have big delays in IP traffic, in other cases, complete packet loss, depending on where each country lies on the["axis of evil"].This is not something just affecting a few isolated areas, the impact is indeed worldwide. This would be a goodtime to talk about how computer signals are actually sent.
DWDM takes up to 80 independent signals, converts each to a different color of light, and sends all the colors down a single strand of glass fiber. At the receiving end, the colors are split off by a prism,and each color is converted back to its original electrical signal.
Similar DWDM, but only eight signals are sent over the glass fiber. This is generally cheaper, becauseyou don't need highly tuned lasers.
Wikipedia has a good article on [Submarine Communications Cable],including a discussion on how repairs are made when they get damaged or broken.It is important to remember that lost connectivity doesn't mean lost data, just lack of access to the data. Thedata is still there, you just can't get to it right now. For some businesses, that could be disruptive to actualoperations. In other cases, it means that backups or disk mirroring is suspended, so that you only have yourlocal copies of data until connectivity is resumed.
When two cables in the Mediterranean were severed last week, it was put down to a mishap with a stray anchor.
Now a third cable has been cut, this time near Dubai. That, along with new evidence that ships' anchors are not to blame, has sparked theories about more sinister forces that could be at work.
For all the power of modern computing and satellites, most of the world's communications still rely on submarine cables to cross oceans.
It gets weirder. In his blog Rough Type, Nick Carr's[Who Cut the Cables?] reportsnow a fourth cable has been cut, in a different location than the other two cable locations. If the people cuttingthe cables are looking to see how much impact this would have, they will probably be disappointed. Nick Carrrelates how resilient the whole infrastructure turned out to be:
Though India initially lost as much as half of its Internet capacity on Wednesday, traffic was quickly rerouted and by the weekend the country was reported to have regained 90% of its usual capacity. The outage also reveals that the effects of such outages are anything but neutral; they vary widely depending on the size and resources of the user.
Outsourcing firms, such as Infosys and Wipro, and US companies with significant back-office and research and development operations in India, such as IBM and Intel, said they were still trying to asses how their operations had been impacted, if at all.
Whether it is man-made or natural disaster, every business should have a business continuity plan. If you don't have one, or haven't evaluated it in a while, perhaps now is a good time to do that. IBM can help.
I hope everyone had some time these past few weeks of the Winter Solstice to enjoy some time off with friends and family. I had a great trip to New York City, got to visit my brother and his friends, went to see my friends in Michigan to celebrate New Years Eve, and see the world premiere of [LexiBaby], an independent film from fellow filmmaker Jonathan Petro.
The latter of course from fellow IBMers, corporate executives receiving bailout money, attorneys that specialize in foreclosures, and the lucky few who will be in Washington DC for the US Presidential Inauguration.In addition to all the bailout money from banks, insurance companies and automakers that will be spent on IBM equipment and services, there might be additional funds from the US Government to improve our country's information infrastructure.In a recent Forbes article titled[The Tech Solution To The Recession], Andy Greenberg writes about US president-elect Barack Obama's ideas about a stimulus to the economy. Here's an excerpt:
"IBM, for starters, believes that a massive infusion of cash should go toward cutting-edge technology. Last month, IBM CEO Sam Palmisano presented a report to Obama's transition team from the Information Technology and Innovation Foundation (ITIF) that argues that a $30 billion investment in universal broadband, health information technology and a smarter power grid could create 950,000 jobs.
"Those disparities, and IBM's argument for focusing a stimulus plan on technology in general, come from what economists have dubbed "network multipliers." The computing giant, and ITIF, argue that technology creates more jobs than other types of infrastructure by enabling new types of businesses.
"If you build more roads, people don't buy more tires or GPS systems, but if you build better networks, you create entirely new business applications," says Rob Atkinson, president of ITIF and an author of the think tank's report. "Something like YouTube could never have existed without broadband."
"Regardless of precisely how tech stimulus money gets spent, IBM will likely sweep up a significant chunk of those taxpayer funds, given the computing giant's diverse hardware, software and services businesses. Other IT infrastructure giants like Microsoft, Hewlett Packard, Oracle and SAP are also likely to vie for pieces of Obama's stimulus package aimed at technology.
"But among those tech companies, IBM has been especially active in driving home the need for national investment in tech systems. In a November speech to the Council on Foreign Relations, Palmisano argued that that the U.S. needs to invest in innovation not just as a solution to our current recession but as a competitive measure in an increasingly integrated and technologically advanced world."
The [IBM Edge2015 conference] is premiere conference covering Infrastructure Innovations for IBM System Storage, as well as sessions about z Systems and POWER Systems from our IBM Enterprise conference. Check out this short two-minute [YouTube video on IBM Edge2015].
Here is my quick recap of the kickoffs and keynote sessions on the first day, Monday, May 11, 2015.
Storage Systems Technical Kickoff
At the dreadful hour of 8:30am on Monday morning, Clod Barrera and Axel Koester kicked off the Storage portion of Technical Edge.
Clod is IBM Distinguished Engineer and Chief Technical Strategist for IBM's System Storage product line. He discussed IBM's investments in Software Defined Storage, FlashSystem products, and Storage Virtualization.
Axel Koester is IBM Executive IT Specialist and Storage Chief Technologist for the European Storage Center of Competency. Axel discussed IBM's invention of Dynamic Random Access Memory (DRAM) in 1966, and how this led to the development of Programmable Read-Only Memory (PROM), Electronically Erasable PROM (EE-PROM), and NAND Flash systems. Running out of two-dimensional surface for NAND Flash has led to the development of 3D Flash.
Stephen Leonard, Tom Rosamilia and Jen Crozier presented the opening keynote. It is available as a 90-minute YouTube video [IBM Edge 2015 - General Session] compliments of SiliconAngle.
Tom Rosamilia is my fifth-line manager and IBM Senior Vice President of the recently formed "IBM Systems" business unit, comprised of System Storage, z Systems, POWER Systems and Middleware.
By 2016, there will be 26 billion things on the Internet. Connected cars, for example, can serve as Wi-Fi "hot spots" to connect multiple mobile devices in the vehicle. Each mobile transaction triggers up to 100 back-end system transactions. Security is non-negotiable at every stage of these transactions. As an example, client testimonial from TravelPort and Priceline.com indicated that it takes over 90 billion back-end transactions to handle 120 million travel reservations.
Analytics converts raw data into actionable insights. Unfortunately, as much as 90 percent of data never gets analyzed. By combining Systems of Record, Systems of Engagement and Systems of Insight, your IT infrastructure empowers you to engage your customers in the manner they expect. A Hybrid Cloud can help bring these systems together.
Jen Crozier is IBM Vice President, Global Citizenship Initiatives. She asked mayors of cities across the world a simple question, if you had access to six IBM executives and technical experts, what problem would you want them to solve? In partnership with Twitter, IBM donated over $100 million dollars in expertise as "Smarter Cities" grants to address the most challenging problems. The following 16 cities won the grant for 2015 (I have been to eight of them!):
Allahabad, India - Prime Minister Modi of India is interested in having over 100 "Smarter Cities" across the country. IBM will help Allahabad to improve waste management.
Amsterdam, Netherlands - to help the city support new business startups
Athens, Greece - to reduce traffic congestion and offer car-free transportation alternatives
Denver, United States - to coordinate services for the homeless
Detroit, United States - to help with urban recycling, debris and blight to rebuild the city infrastructure
Huizhou, China - to help with tourism management
Melbourne, Australia - to help with disaster preparedness
Memphis, United States - to help coordinate emergency calls across fire, police and medical departments
Rochester, New York, United States - to help with assistance to families with children living in poverty
San Isidro, Peru - to help with traffic congestion and related pollution
Santiago, Chile - to help with disaster preparedness, especially important given the recent earthquakes, landslides, floods and fires
Sekondi-Takoradi, Ghana - to help expand its tax base to reduce corruption
Surat, India - to help integrate urban planning across agencies
Taichung, Taiwan - to help with road safety and traffic congestion
Vizag, India - to help with disaster preparedness in flood and cyclone prone areas
Xuzhou, China - to help optimize transportation as a regional hub
The mayor of Memphis TN, A C Wharton, gave a quick acceptance speech, introducing his chiefs of fire department and police departments, and explaining his focus to better serve his citizens.
Stephen Leonard highlighted some of the key products announced this year, including the z13 System mainframe, the new 4-socket E840 POWER System, and the FlashSystem V9000 storage system. Nobody supports more open standard than IBM, including Linux, OpenStack, Apache, Eclipse, Cloud Foundry, SPARK and Hadoop.
The kickoff sessions and keynote presentations are always a great way to set the context for the rest of the week.
IBM hired independent analyst Enterprise Strategy Group[ESG] to validate the box, and run workload-specific benchmarks. I agreewith Chris, the results are impressive! The report includes results from Microsoft Exchange JetStresstool to provide insight into email performance, and another benchmark to simulate Web server IOPS.
Also, the published SPC-1 benchmark for the DS5300 puts it at about 29 percent improvement over the DS4800.Chris argues the DS5300 is similar in class to NetApp FAS3170, which IBM sells as the IBM System Storage N6070.
If you are interesting in either the DS5300 or N6070, contact your local IBM Business Partner or sales rep.
In case you haven't noticed, IBM System Storage makes most of their announcements on Tuesdays. IBM announced a lot today, so here is a quick run-down.
Cisco storage networking products
IBM continues to resell Cisco switches and directors, but now can offer these with a 1-year IBM warranty.
The entry-level Cisco 9124offers 8 to 24 ports. For IBM BladeCenter, IBM now offers the Cisco10-port and 20-port modules that slide into the back of the chassis, and are functionally equivalent to the 9124.The original BladeCenter came with a 16-port module with 14 internal, but only 2 external, which severely hamperedbandwidth connectivity to external storage. These new modules provide more external ports to relieve that constraint.
The midrange Cisco9200switches have two models, both with 16 fixed ports, with the option for a blade that can provide 12, 24 or 48 additional ports. The 9216A has 16 FCP ports, and the 9216i has 14 FCP ports, and 2 GbE ports to act as a router, such as toconnect to a remote location for business continuity using Metro Mirror or Global Mirror.
The enterprise-class Cisco 9500directors can support up to 528 ports.
TS3400 Tape Library
The new TS3400library is a small entry-level size library, supporting the enterprise-class TS1120 drive, providing interoperabilitywith the larger tape libraries, with all the support for tape encryption.
In addition to Linux, Unix, and WIndows, the TS1120 can now be connected to System i servers. In the past, the only IBMtape available to System i were the LTO models. There are a lot of businesses that need to comply with government regulations that are looking for tape encryption, and now IBM has made it accessible to more clients.
300GB drives at 15K RPM
The DS8000 can now support new drives with 300GB capacity at 15,000 RPM (15K). These can be up to 30 percent faster than the 10,000 RPM drives for typical workloads.
IBM continues its market leadership with these new set of features and offerings!
IBM released its [2008 Annual Report]. IBM has improved in revenues, profits and earnings per share compared to recent past years. Part of the success comes from IBM's focus on [generating higher value].Here are some excerpts:
"Several years ago, we saw change coming.
Value was shifting in the IT industry, driven by the rising tide of global integration, a new computing paradigm and new client needs. These shifts meant the world was becoming not just smaller and “flatter,” but also smarter.
We remixed our businesses in order to move to the emerging higher-value spaces.
IBM has divested commoditizing businesses like personal computers, and strengthened its position through strategic investments and acquisitions in higher-value segments like business intelligence and analytics, virtualizationand green solutions.
From 2000 to 2008 we acquired more than100 companies to complement and scale our portfolioof products and offerings. This has changed ourbusiness mix toward higher-value, more profitable segments of the industry.
We became a globally integrated enterprise in order to capture the best growth opportunities and improve IBM’s profitability.
IBM operates in more than 170 countries and enjoys an increasingly broad-based geographic reach.Our non-U.S. operations generated approximately65 percent of IBM’s revenue in 2008. IBM’s Growth Markets unit, which was established in 2008,grew 10 percent last year, and made up 18 percentof our revenues. Revenue increased 18 percent(15 percent in local currency) in Brazil, Russia, India and China.
As a result, IBM is a higher-performing enterprise today than it was a decade ago.
Our business model is more aligned with our clients’ needsand generates better financial results.
We have therefore been able to invest in future sources of growth and provide record return to investors…
…while continuing to invest in R&D—more than $50 billion from 2000 to 2008.
This gives us confidence that we are entering the current economic environment from a position of strength…
In 2008 we made progress toward our 2010 objectivesby growing earnings per share 24 percent. And withthis strong 2008 performance, we are clearly ahead of pace on our road map to $10–$11 of earnings per share.
…and that we will emerge from it even stronger, thanks to our long-term fundamentals and our agenda for a smarter planet.
All around the world, businesses, governmentsand institutions are investing to reduce costs,drive innovation and transform their infrastructure. The economic downturn has intensified this trend,as leaders seek not simply to repair what isbroken, but to prepare for a 21st Century economy.
Many of their key priorities are in areas whereIBM has leading solutions—such as smarter utility grids, traffic, healthcare, financial systems,telecommunications and cities. We are aggressively pursuing this transformational, global opportunity."
It is good to see that IBM continues to proceed with long-term investments during these tough times!
Continuing this week's theme on dealing with the global economic meltdown, recession and financial crisis, I found a great video that recaps IBM CEO Sam Palmisano's recommendations to being more competitive in thisenvironment.
In a recent speech to business leaders, Sam outlined what he sees as the four most importantsteps to thriving in the global economy. The highlights can be seen here in this [2-minute video]on IBM's "Forward View" eMagazine.
This week, I am attending the [InterConnect Conference] in Las Vegas, Feb 21-25, 2016. This is IBM's premier Cloud & Mobile conference for the year.
Wednesday morning I attended more break-out sessions.
1273: New IBM DS8880 Family: Always-On Data at Cloud Speed
Brian Sherman (with support from Eddie Lin) explored the business value that the IBM System Storage DS8000 series provides to organizations requiring ultimate performance and availability.
Brian reviewed the DS8000 advanced functions, including those that have recently become available, and explains what benefits they provide. While he focused on the latest DS8880 family, some of these were also available on the prior DS8870 models.
Cloud-related features include OpenStack Cinder drivers, REST interfaces, Mobile app monitoring, zKVM and PowerVC support, use of IBM Spectrum Control Base, VMware VAAI primitives, SRA and Web-admin plugin support.
3015A Open Doors with an OpenStack Approach
Mohammed "Mo" Abdula, IBM, presented this overview of IBM's involvement with OpenStack, including BlueBox, which provides a private on-premises OpenStack deployment.
Most enterprises know that a single approach to cloud adoption, whether public or private, will not optimize business results. Connecting one or more clouds to traditional systems, or other clouds, is a realistic and achievable strategy.
OpenStack, being an open technology, is making it easy for enterprises to customize the way they deploy mission-critical business applications.
Code, Community and Culture enable innovation - Cloud should hide the details so that people can focus on what is important. OpenStack is opening the doors for enterprises to quickly get on the Cloud journey.
The automotive industry heavily uses OpenStack. Mo gave an example of a successful promotion by a car dealer that resulted in great sales revenues through social media. The app was developed on IBM SoftLayer than moved on-premises. OpenStack interfaces made it possible.
7186A IBM Spectrum Storage Experiences
Douglas O'Flaherty, IBM, served as emcee for this exciting discussion. Three clients presented their success stories with various Spectrum Storage software. Each speaker had 20 minutes to present their story.
Paul Rafferty, IBM Silverpop
Silverpop was a started that provides Marketing automation, empowering marketers with cloud-based capabilities and cutting-edge big data analytics that deliver personalized customer engagements that scale for any sized business. It was IBM acquired in 2014, but Paul presented as a client of IBM Spectrum Accelerate.
To support clients, Silverpop does everything in the Cloud. With their acquisition by IBM, they have switched to using IBM SoftLayer. To that end, they needed robust storage that provides snapshots, consistency groups, and remote disk-to-disk replication, so they selected bare-metal servers running with IBM Spectrum Accelerate, which is the software-only implementation of XIV storage systems.
Silverpop deploys Spectrum Accelerate on either 7-node or 15-node clusters, with an additional spare-node pre-configured in case of failure. Each node is a 2U x86 server with dual 8-core Intel Xeon E5-2650 processors, 128 GB RAM, two 800GB Solid-State Drives (SSD) and 10 SATA drives 4TB capacity each. The 7-node provides about 120TB of usable capacity, and the 15-node about 255 TB.
Worldwide, Silverpop has 1,500 nodes deployed across 10 IBM SoftLayer datacenters, running 15,000 virtual machines. The virtual machines run on the same nodes as Spectrum Accelerate, including Oracle database, DB2 database, HDFS file system, and Spark analytics. They use Chef and UrbanCode for orchestration and code deployment.
If you ask 10 different Spectrum Protect architects how to design a system, you get a wide variety of answers. Blueprints reduce this complexity down to three "T-shirt" sizes: Small, Medium, and Large, based on the amount of backup traffic per day. Small for deployments less than 6 TB per day, Medium for 6-20 TB per day, and Large for over 20 TB per day.
The blueprints can be deployed on Windows, Linux-x86, Linux on POWER, and AIX. They are disk-based storage pools using either IBM Storwize family or Elastic Storage Server models. The blueprints include configuration scripts that can be customized, and Joe suggested tips for those who want to incorporate tape storage pools.
Bob Oesterlin, Nuance
Nuance creates their Nuance Dragon® voice-recognition dictation software. They process 7500 TB per day, 85% read, 15% write traffic. They have 6 PB of Spectrum Scale file system.
To free up space and reduce costs, Nuance stood up their own OpenStack Swift object-store on storage-rich servers. Files that have turned cold were moved out of Spectrum Scale and into this Object Store, which has now grown to over 4 PB of capacity. Unfortunately, there was no way for end-users who had files on Scale to find them after they were moved to Object Store.
IBM has solved this with Transparent Cloud Storage Tiering, which is currently in open beta. With this new approach, files are "migrated" from Spectrum Scale to Cleversafe object-store, but a stub is left behind in the file system directory so that they can be "recalled" back to Spectrum Scale. This is the same methodology IBM uses to migrate/recall data to tape.
I would vote this the best session I have seen all week! Each client solved real-world business problems with Spectrum Storage software.
To encourage traffic through the Solutions EXPO, foot traffic was re-directed through the booths to get to lunch. This reminds me of having to go through the "gift shop" when you leave amusement rides or museums.
If you are looking for a reason to travel to Florida next month, IBM will be presenting at the [Storage Networking World conference], April 6-9, 2009 in Orlando. This conference is organized by ComputerWorld and the Storage Networking Industry Association [SNIA]. IBM is a platinum sponsor for this event, and will have various executives presenting IBM's leadership in storage:
Barry Rudolph, VP, Strategy and Stack Integration, Storage Platform
IBM will be demonstrating solutions throughout the conference, includingeight SNIA tutorial and breakout speaking sessions, a panel discussion, two new Summits (Cloud Computing, and Solid-State Storage), and four Hands-on-Labs:
Plus, IBM will have a huge 10 foot by 20 foot booth located in the Expo hall and a kiosk in the Platinum Galleria. The demonstrations highlighted in the IBM booth will showcase Information Infrastructure solutions, which will help simplify, reduce risk, increase efficiency and lower costs. I won't be there myself, but you can ask my IBM colleagues about:
The Next Generation of Storage: IBM XIV Storage System
Storage Virtualization with SAN Volume Controller (SVC)
Infrastructure Management with IBM Tivoli Storage Productivity Center (TSPC)
Data Deduplication using the IBM ProtecTIER solution
Storage and Data Services
As sponsor of this event, IBM has received a limited number of free conference passes. We will be assigning these upon request to IBM clients and prospective clients. If you would like to go, contact your IBM Business Partner or local storage rep.Act fast! First come, first served.
Continuing my week's theme on how bad things can get following the "Do-it-yourself" plan, I start with James Rogers' piece in Byte and Switch, titled[Washington Gets E-Discovery Wakeup Call]. Here's an excerpt:
"A court filing today reveals there may be gaps in the backup tapes the White House IT shop used to store email. It appears that messages from the crucial early stages of the Iraq War, between March 1 and May 22, 2003, can't be found on tape. So, far from exonerating the White House staffers, the latest turn of events casts an even harsher light on their email policies.
Things are not exactly perfect elsewhere in the federal government, either. A recent [report from the Government Accountability Office (GAO)] identified glaring holes in agencies’ antiquated email preservation techniques. Case in point: printing out emails and storing them in physical files."
You might think that laws requiring email archives are fairly recent. For corporations, they began with laws like Sarbanes-Oxley that the second President Bush signed into law back in 2002. However, it appears that laws for US Presidents to keep their emails were in force since 1993, back when the first President Clinton was in office. (we might as all get used to saying this in case we have a "second" President Clinton next January!)
"The Federal Record Act requires the head of each federal agency to ensure that documents related to that agency's official business be preserved for federal archives. The Watergate-era Presidential Records Act augmented the FRA framework by specifically requiring the president to preserve documents related to the performance of his official duties. A [1993 court decision] held that these laws applied to electronic records, including e-mails, which means that the president has an obligation to ensure that the e-mails of senior executive branch officials are preserved.
In 1994, the Clinton administration reacted to the previous year's court decision by rolling out an automated e-mail-archiving system to work with the Lotus-Notes-based e-mail software that was in use at the time. The system automatically categorized e-mails based on the requirements of the FRA and PRA, and it included safeguards to ensure that e-mails were not deliberately or unintentionally altered or deleted.
When the Bush administration took office, it decided to replace the Lotus Notes-based e-mail system used under the Clinton Administration with Microsoft Outlook and Exchange. The transition broke compatibility with the old archiving system, and the White House IT shop did not immediately have a new one to put in its place.
Instead, the White House has instituted a comically primitive system called "journaling," in which (to quote from a [recent Congressional report]) "a White House staffer or contractor would collect from a 'journal' e-mail folder in the Microsoft Exchange system copies of e-mails sent and received by White House employees." These would be manually named and saved as ".pst" files on White House servers.
One of the more vocal critics of the White House's e-mail-retention policies is Steven McDevitt, who was a senior official in the White House IT shop from September 2002 until he left in disgust in October 2006. He points out what would be obvious to anyone with IT experience: the system wasn't especially reliable or tamper-proof."
So we have White House staffers manually creating PST files, and other government agencies printing out their emails and storing them in file cabinets. When I first started at IBM in 1986, before Notes or Exchange existed, we used PROFS on VM on the mainframe, and some of my colleagues printed out their emails and filed them in cabinets. I can understand how government employees, who might have grown up using mainframe systems like PROFS, might have just continued the practice when they switched to Personal Computers.
Perhaps the new incoming White House staff hired by George W. Bush were more familiar with Outlook and Exchange, and ratherthan learning to use IBM Lotus Notes and Domino, found it easier just to switch over. I am not going to debatethe pros and cons of "Lotus Notes/Domino" versus "Microsoft Outlook/Exchange" as IBM has automated email archiving systems that work great for both of these, as well as also for Novell Groupwise. So, taking the benefit of the doubt,when President Bush took over, he tossed out the previous administration's staff, and brought in his own people, andlet them choose the office productivity tools they were most comfortable with.Fair enough, happens every time a new President takes office. No big surprise there.
However, doing this without a clear plan on how to continue to comply with the email archive laws already on the books, and that it continues to be bad several years later, is appalling. I can understand why business are upset in deploying mandated archiving solutions when their own government doesn't have similar automation in place.
"Our survey data shows that over the past 12 months, more firms have bought their storage from a single vendor. While this might not be for everyone, it's worth serious consideration for your environment. Maybe you won't get the best price per gigabyte every time, but you'll probably save money in the long run because of simpler management, increased staff specialization, increased capacity utilization, and better customer service."
A Forrester survey of 170 companies ranging from SMBs to large enterprises in North America and Europe found that more than 80 percent bought their primary storage from one vendor over the last year. That includes 64 percent of the companies with more than 500 TB of raw storage.
The report, written by analyst Andrew Reichman, says using more than one primary storage vendor can make it more complex to manage, provision and support the storage environment. And while using multiple vendors can often bring better pricing, buying from one vendor can result in volume discounts.
“You may have tried to contain costs by forcing multiple incumbent vendors to continuously compete against each other, with price as the primary differentiator,” Reichman writes. “This strategy can reduce prices and limit vendor lock-in, but it can also lead to management complexity and poor capacity utilization.”
The report recommends keeping things simple by and using fewer vendors when possible. However, that advice comes with several caveats: buying all storage from one vendor means taking the bad with the good, and some vendors’ product families differ so much “they may as well come from different vendors.”
As if by coincidence, fellow blogger from EMC Chuck Hollis gives his reflections on this same topic. Here's an excerpt:
When it comes to buying storage (or any infrastructure technology, for that matter), there seem to be two camps:
Best-of-breed (i.e. multivendor): -- buy what's best, get the best price, keep all the vendors on their toes, etc. etc.
Single vendor: primarily use one vendor's offerings, and hold them accountable for the outcome.
If Chuck had said "multivendor" versus "single vendor", then that would have been a true dichotomy, but interestinglyhe equates best-of-breed with a multivendor approach. Let's consider two examples:
Disk from one vendor, Tape from another
Here is a multivendor strategy, and if you have a clear idea of what best-of-breed means to you, then you couldpick the best disk in the market, and the best tape in the market. However, I don't think this keeps either vendor"on their toes", or helps you negotiate lower prices by threatening to switch to the other vendor. In shops likethis, the staffing usually matches, so there are disk administration and tape operations, with little or no overlap, andlittle or no interest in retraining to use a new set of gear. It is true that disk-based VTL could be used where real tape libraries are used, but this may not be enough to threaten your existing vendors that you will switch all your disk to tape, or all your tape to disk.
One could argue that the vendor that sells the besttape could be the exact same vendor that sells the best disk. In this case, your multivendor strategy would actuallywork against you, forcing you away from one of your best-of-breed choices.
Disk and Tape from one vendor for some workloads, Disk and Tape from another vendor for other workloads
Here is a different multivendor strategy. Having disk and tape for the same vendor allows you to take advantageof possible synergies. The IT staff knows how to use the products from both vendors. This strategy does let you keep your vendors "on their toes". You can legitimately threaten to shift your budget from one vendor over another.However, whatever your definition of best-of-breed is, chances are the product from one vendor is, and the other vendor is not. Both meet some lowest common denominator, meeting some minimum set of requirements, which would allow you to swap out one for the other.
I guess I look at it differently. The equipment in your data center should be thought of as a team. Do your servers, storage and software work well together?
While Americans like to celebrate the accomplishments of individual musicians, athletes or executives, it is actually bands that compete against other bands, sports teams that compete against other sport teams, and companies that compete against other companies. Teamwork in the data center is not just for the people who work there, but also for the IT equipment. Just as a new incoming athlete may not get along well with teammates, shiny new equipment may not get along with your existing gear. Conversely, your existing infrastructure may not let the talents or features of your new equipment shine through.
Putting together the best parts from different teams might serve as a great diversion for those who enjoy["fantasy football"], it may not be the best approach for the data center. Instead, focus on managing your data center as a team, perhaps with theuse of IBM TotalStorage Productivity Center to minimize the heterogeneity of your different equipment. Pick an ITvendor that sells "team players" for your servers, storage and software, with broad support for interoperability and compatibility.
Continuing my theme of "Innovation that matters", I thought I would cover MapQuest and NeverLost.
When Shawn Callahan on Anecdote wrote[Our need for the knowledge worker is over], he was referring to the fact that we no longer need the term "knowledge worker", because practically everyone isa "knowledge worker" today. He asks "How does knowledge help us to work better?"
It is said that as much as 30 percent of a knowledge worker's time is spent looking for information to do their jobs. This could be information to make a decision, decide between several choices, take specific action, or schedule when these actions should take place. The logistics of planning a business trip, and actually navigating in unfamiliarsurroundings, is a good example of this, and presents some unique challenges.
Before these technologies
Before these technologies, to plan a trip involved finding someone who lives or has been to the destination city,can recommend hotels and restaurants near the meeting facility, and can suggest approximate times it would take to drive from one place to another. I would bring a compass, and would shop for a city map, either before leaving, or upon arrival.
On one trip to Raleigh, I asked a local IBMer who lived in Raleigh for a hotel recommendation. The hotel was nice,but involved a long 45-60 minute commute each day to the meeting facility. When I asked her why she suggested thatparticular hotel, she said it was because it was "close to the airport". I have since learned never to ask for "best" of anything, as this is subject to such interpretation.
On another trip, I was travelling with a colleague in Germany. He asked how I knew which bus to take, and which bus stop to wait at. I pulled out my compass, and told him that based on the schedule, the bus that went in a specific directionmust be the correct one. The entire bus load of people burst out laughing, that we fit the universal stereotype ofmen who refuse to ask for directions. This method works only in Germany, where timeliness is next to godliness. In other countries, time schedules are more of a suggestion.
Sometimes, maps of the destination city were not always easy to find. Now with the Internet and Google Earth, maps are available before leaving on the trip. (See my post on Inner Workings of Storage which discusses how Google Earth works.)
I like using MapQuest, available online at [mapquest.com], and have not yet looked into the similar systems from Google or Yahoo. I map out each leg of my trip that involves driving, walking or trains. These are oftenairport-to-hotel, hotel-to-meeting, meeting-to-airport. Having a feel for the time and distances between locationshelps choose hotels and restaurants, when to leave, and so on.
I even use MapQuest in Tucson. Recently, a route I generated to visit a friend across town took into accountconstruction on Highway I-10 that has been going on for a while, where 8 miles of on-ramps are closed, and routed me around this mess accordingly. This is one key advantage over a static map, either a paper map, or downloaded from Google Earth.
While MapQuest may not always choose the "best" route, it always finds "a route" that works, and generally works for me.
A few problems with a MapQuest print-out I have found are:
It is on paper, which could impact driving, as I have to look away from the road to look at the instructions.
If it can't find a specific address, it provides generic instructions, and often, this involves airports.
It often starts with "Head Northeast...", so unless you brought your compass, or can tell what direction you are pointing from Sun, Moon or stars, you may end up leaving in the wrong direction.
Recently, I checkmarked the "Request NeverLost" box on my Hertz Gold profile, and now I seem to get NeverLost innearly every rental. The system is based on the[Global Positioning System] set of satellites,complemented by a CD-based street information and yellow pages data for US and Canada, stored in the trunk.
The NeverLost system knows which way the car is oriented, can tell which direction you are driving, and tell youwith voice prompts to be in the left lane, right lane, and when to make left and right turns. No need for a compassor any knowledge of which way is North, East, West or South.
I also like that it gives you three choices for route: (a) Shortest time, (b) Most use of Highways, and (c) Least use of Highways. This came in handy when I was in Toronto last week. Apparently, the 407 Highway had recently implementedan Electronic Toll Road (ETR) which bills based on license plate. While this system is fine for residents, it isnot designed for rental car companies. Hertz left a note in my car warning me NOT to use the 407 highway, or I wouldbe charged an $8.50 dollar penalty. I chose "Least use of Highways" and proceeded to tour the city of Toronto for90 minutes from the Pearson Airport to my hotel in Markham, a trip that would have only taken 20 minutes otherwise.
Once you enter your destination street address, it can estimate the distance to get there. This is not a quick process, as there is no keyboard, you have to enter each letter using up/down/left/right keys. You can enter thename of the street, hotel or restaurant. To find "Sal Grosso" restaurant in Smyrna, it was at 1927 Powers Ferry Road,but NeverLost said that Powers Ferry only went from 2750-6350. I had to select 2750 and then hope to be close enough.
In Dallas, I tried to find "P. F. Chang's" restaurant, and you have to make sure that the periods and spaces are entered exactly. I ended up looking for restaurants in Grapevine, Texas, and then just going through the list ofall that start with the letter "P".
Another issue is that sometimes it takes awhile to find the satelites in the sky. I get the car started, I hit theenter button to get the NeverLost started, enter the address, and then it starts looking for satellites? Why doesn'tit look for satellites while you spend 3-5 minutes trying to enter the street address?In my case, I take out my MapQuest print-out, head in the right direction, and hope that NeverLost catches upeventually, in time to help me get to the final location.
It is not clear how often Hertz updates the CDrom that contains the street and yellow pages data. About 30-40 percent of the time, it can't find the street address I am looking for, and I have to be creative on howto get me in the general area.
Part of the problems is that I have not read the entire instruction manual, and do not have time to learn itwhen I am in the car driving. I might have to put this on my reading to-do list before my next trip. Some ofmy other colleagues have purchased their own GPS-based systems, like those from Garmin or Magellan, so that theyalways have it available, and they always know how to use it. This has the advantage that you can use it when walking around, or in your own car when you are home, as well.
Despite these few problems, I am impressed on the innovations involved to make this all happen. All of the mapping information was stored, transmitted, searched, and then plotted in a manner that provides specificinformation that you need to get the job done. For now, I will probably use a combination of these to planand travel on my business trips. Wouldn't it be nice if other areas in your life had this kind of support?
Here we are again at Top Gun class.In between class topics, we often show short video clips.
This week, we saw IBM Executive Bob Hoey's wisdom on selling mainframe computers. Bob is the VP of Sales for our System z server line, but the lessons might also apply to high-end disk or enterprise tape libraries.
Continuing my coverage of the 27th annual[Data Center Conference], the weather here in Las Vegas has been partly cloudy,which leads me to discuss some of the "Cloud Computing" sessions thatI attended on Wednesday.
The x86 Server Virtualization Storm 2008-2012
Along with IBM, Microsoft is recognized as one of the "Big 5" of Cloud Computing. With theirrecent announcements of Hyper-V and Azure, the speaker presented pros-and-cons between thesenew technologies versus established offerings from VMware. For example, Microsoft's Hyper-Vis about three times cheaper than VMware and offers better management tools. That could beenough to justify some pilot projects. By contrast, VMware is more lightweight, only 32MB,versus Microsoft Hyper-V that takes up to 1.5GB. VMware has a 2-3 year lead ahead of Microsoft, and offers some features that Microsoft does not yet offer.
Electronic surveys of the audience offered some insight. Today, 69 percent were using VMware only, 8 percent had VMware plus other, including Xen-based offerings from Citrix,Virtual Iron and others. However, by 2010, the audience estimated that 39 percent would be VMware+Microsoft and another 23 percent VMware plus Xen, showing a shift away from VMware'scurrent dominance. Today, there are 11 VMware implementations to Microsoft Hyper-V, and thisis expected to drop to 3-to-1 by 2010.
Of the Xen-based offerings, Citrix was the most popular supplier. Others included Novell/PlateSpin,Red Hat, Oracle, Sun and Virtual Iron. Red Hat is also experimenting with kernel-based KVM.However, the analyst estimated that Xen-based virtualization schemes would never get past8 percent marketshare. The analyst felt that VMware and Microsoft would be the two dominant players with the bulk of the marketshare.
For cloud computing deployments, the speaker suggested separating "static" VMs from "dynamic" ones. Centralize your external storage first, and implement data deduplicationfor the OS load images. Which x86 workloads are best for server virtualization? The speaker offered this guidance:
The "good" are CPU-bound workloads, small/peaky in nature.
The "bad" are IO-intensive, those that exploit the features of native hardware
The "ugly" refers to workloads based on software with restrictive licenses and those not fully supported on VMs. If you have problems, the software vendor may not help resolve them.
Moving to the Cloud: Transforming the Traditional Data Center
IBM VP Willie Chiu presented the various levels of cloud computing.
Software-as-a-Service (SaaS) provides the software application, operating system and hardware infrastructure, such as SalesForce.com or Google Apps. Either the software meets your needs or it doesn't, but has the advantage that the SaaS provider takes care of all the maintenance.
Platform-as-a-Service (PaaS) provides operating system, perhaps some middleware like database or web application server, and the hardware infrastructure to run it on. The PaaS provider maintains the operating system patches, but you as the client must maintain your own applications. IBM has cloud computing centers deployed in nine different countries across the globe offering PaaS today.
Infrastructure-as-a-Service (IaaS) provides the hardware infrastructure only. The client must maintain and patch the operating system, middleware and software applications. This can be very useful if you have unique requirements.
In one case study, Willie indicated that moving a workload from a traditional data center to the cloud lowered the costs from $3.9 million to $0.6 million, an 84 percent savings!
We've Got a New World in Our View
Robert Rosier, CEO of iTricity, presented their "IaaS" offering. "iTricity" was coined from the concept of "IT as electricity". iTricity is the largest Cloud Computing company in continental Europe, hosting 2500 servers with 500TB of disk storage across three locations in the Netherlands and Germany.
Those attendees I talked to that were at this conference before commented that this year's focus on virtualization and cloud computing is noticeably more than in previous years. For more on this, read this 12-page whitepaper:[IBM Perspective on Cloud Computing]
Shakespeare wrote "What's in a name? That which we call a rose by any other word would smell as sweet." This week my theme will be on names, naming convention, and how we access information on storage.
Take for example these two sentences:
The Bears beat New Orleans. Chicago clobbered the Saints.
Though they appear very different, football fans who might have watched either or both of the two conference title games yesterday would quickly recognize that they refer to the same two teams and the same end-result.
I'll be traveling to Asia next week. While most people call me "Tony", my legal given name is "Anthony" which is what appears on my passport and other legal documents. Most English-speaking countries handle this fine, but it can be confusing in Japan or China, where "A. Pearson" doesn't match "T. Pearson".
In the US, our given and family names are referred to as our "first name" and our "last name", relating to their positional sequence. In Asia, family names come first, followed by their given names last. To help avoid confusion, we have started adopting the practice of putting the family name in ALL CAPITAL LETTERS, so I would "Tony PEARSON" while my colleague may be "WONG Francis".
In Japanese, "Mr. JONES" would be "Jones-san". However, Pearson-san is such a toungue-twister, that most just say "Tony-san" which is fine with me. I have been called "Mr. Tony" in a variety of countries, perfectly acceptable.
You can call me anything you like, just don't call me late for dinner.
This week, I am attending the [InterConnect Conference] in Las Vegas, Feb 21-25, 2016. This is IBM's premier Cloud & Mobile conference for the year.
Monday morning I attended the General session and a break-out session.
7030A General Session Day 1: Digital Business Transformation
The General Session was kicked off by severak clients:
Richard Holmes, Westpac Group, a 200-year-old bank with 21,000 branch locations across Australia and New Zealand. They have migrated 70 percent of their applications to the Hybrid Cloud. Provisioning server and storage resources went from 84 days to just minutes.
Matthias Rebellius, Siemens AG, Building Services. They use IBM Watson IoT to monitor the energy usage of their buildings. They have reduced energy consumption 20 to 30 percent, eliminating over 10 million cubic feet of CO2 greenhouse gas.
Robert LeBlanc, IBM Senior Vice President for Cloud, took the stage and welcomed the 23,000 attendees. Developers are turning to IBM Cloud to deliver timely, knowledgeable, and secure experiences for their customers and end-users. Business leaders are seeking new ways to enable their companies to securely implement hybrid cloud strategies that integrate mobile, IoT, and cognitive. He focused on five areas:
Choice, but with Consistency
Hybrid Cloud Integration
Powerful, Accessible data and analytics
Robert indicates that 100 percent of our strategic software products are now Hybrid-Cloud enabled. We get over 3.2 billion API calls per month, and 20,000 new IBM Bluemix users per month. More than 7,000 startups are now running on IBM SoftLayer. IBM was once again ranked #1 for Hybrid Cloud by industry analysts.
IBM predicts that 80 percent of Internet traffic will be video by year 2019. To that end, IBM offers Aspera, Ustream, and Cloudleap.
New IBM Watson APIs can analyze "tone", "emotion" and "vision".
IBM has partnered with Github to offer an Enterprise-class Github-as-a-Service offering suitable for business use.
IBM "Open for Data" has over 150 pre-populated public data sources for use with analytics. This allows applications to analyze their own data in context with public sources.
Carl Eschenbach, VMware, emphasized its partnership with IBM, announcing the ability to run VMware on IBM SoftLayer "bare metal" systems, enabling features like NSX networking and VSAN virtual storage.
Brian Cross, Apple Vice President of Product Marketing, presented the enormity of Apple's developer ecosystem:
1.5 million apps on Apple iOS application store
11 million developers making these apps
100 billion downloads of these apps
1 billion Apple devices
In the past, these developers used Xcode development environment. To take the most advantage of Apple hardware features, many developers use C or C++ programming languages to develop "Native Apps".
Apple developed a new programming language called Swift that has already made it to the top 20 development languages. He gave a demo of "Swift Playground" that allows developers see their apps running while they develop and edit the code.
Apple has made Swift open source, and extended its use across iOS, Mac OS X, Watch OS, tvOS and even Linux operating systems. This means you can write code for devices, client workstations and even servers in your datacenter or Cloud. Download it at [Swift.org].
John Ponzo, IBM Fellow, Vice President and CTO of MobileFirst, wrapped up the General session. He mentioned the "IBM Swift Sandbox" service that helps developers learn Swift programming:
Kitura -- This open source framework would allow developers to build end-to-end applications, deploy, and collaborate on web services and applications written in Swift. Kitura allows developers to build front-end and back-end code using Swift as the programming language to help simplify modern application development.
OpenWhisk -- A feature on IBM Bluemix that provides an event-driven computing service for dynamic applications. It competes against Amazon's Lambda service.
With new ways to deploy Hybrid Cloud, using new composable development tools, it is clear that "Cloud" is not merely a destination, but a new innovation platform.
1581A University of Chicago Taps into IBM Cloud Object Storage for More Effective Patient Treatments
This session was 30 minutes with Piers Nash, University of Chicago - Center for Data Intensive Science (CDIS), client testimonial, followed by Russell Kennedy, IBM, that covered an overview of Cleversafe used in the solution.
University of Chicago's Center for Data Intensive Science (CDIS) accelerates medical discoveries by democratizing access to data for scientific research. Utilizing an object storage solution, CDIS centrally stores and manages vast amounts of genomic and clinical data at web-scale, allowing researchers to collaborate via shared access to harmonized data sets, speeding discovery and enabling precision medicine.
Their initial focus is cancer research. Cancer costs over $100 Billion USD per year in healthcare costs. It is #1 killer among people under 85 years old, affecting half of all men, and a third of all women. There are 1.7 million new cancer cases in the USA every year, 15 million worldwide.
There is no "single cure" for cancer. Whereas all humans share nearly identical 3.2 billion base pairs of genetic material, there are over 15,000 different kinds of cancers, each with its own genome. Capturing RNA sequences of patients results in images 10-20 GB in size, and over the course of treatment could add up to 1 TB of image data per patient. A million patients with 1TB of data each would be an Exabyte of data (1,000 Petabytes).
To store all of this data, CDIS created the Bionimbus Protected Data Cloud, using Cleversafe as the underlying storage technology. This system goes live June 2016, and they plan to keep the data forever.
(We'll see how well that goes 10 years from now! It might be cheaper just to re-sequence a human's DNA as needed, rather than storing it forever, since an individual's DNA never changes.)
The data is "de-identified" meaning that researches using the data are unable to identify individual people associated with each case study or genomic result. They have already collected 1.66 PB of this data.
Most cancer treatments that have been effective have focused on specific genetics. The problem is targeting precise therapies to the right patients. For example, there are two very similar Lung cancers, and about 20 percent of the time, a Lung cancer is mis-identified, such that the patients has adverse reactions to the wrong treatment. By having more analytics-based medicine, the hope is to reduce this trial-and-error approach.
Russ Kennedy, IBM, wrapped up the session explaining Cleversafe, which was a Chicago-based company formed in 2004 that was acquired last year by IBM. Why did University of Chicago choose Cleversafe? Several reasons:
University of Chicago attempts to use open source projects like Gluster or Ceph failed around the 1-2 PB mark. They knew they would need much more than this!
Cleversafe was a Chicago-based company, offering local support
IDC ranked Cleversafe #1 marketshare leader of object storage in 2014 and 2015! It beats out competitors like Dell/EMC and Salty, as well as Cloud Service Providers like Amazon or Google.
Why object storage? IBM predicts a 332 percent growth in data generated from Mobile devices. As much as 90 percent of traffic on Mobile devices will be from Cloud apps rather than voice or text messages. There will be a 10-fold increase of data stored by year 2020, and at least 80 percent of this data will be unstructured content. Cleversafe estimates that managing object storage requires 15x fewer administrators than traditional storage.
Cleversafe consists of three components. The "Accessor" is software that runs bare metal, as Virtual Machine or Docker container. It offers the OpenStack Swift, HTTP/REST and Amazon S3 object-based interfaces to ingest the data. The data is encrypted, divided into pieces, then through a process called [Erasure Coding] is converted to slices. Those slices are stored on storage-rich servers called "storage nodes".
For example, five pieces of data converted to nine slices could be stored on nine machines, three machines at Site 1, three at Site 2, and three at Site 3. You only need to read back any five slices to reconstruct the data, so you could lose any four of the nine machines and still have full recoverability. If the 5/9 example above, you could lose any one site, and a machine in one of the two remaining surviving sites, and still retrieve all of your data.
There is now an "open beta" called the Transparent Cloud Storage Tiering that bridges GPFS and Spectrum Scale over to Cleversafe.
I wrapped up the morning with a lunch at Border Grill with storage clients and IBM Business Partners. This was the best steak I have had this week!
This week, I presented at the "IBM TechU Comes to You" event in beautiful Dubai, United Arab Emirates. This was a three-day event, so here is my recap of Day 2.
Introducing the Spectrum Storage Suite
Mike Griese (IBM WW Spectrum Storage Software Evangelist) presented an overview of the IBM Spectrum Storage family of products, and the new IBM Spectrum Storage Suite license which drastically simplifies the TB-licensing of all six products into a single number.
Spectrum Scale - introduction, use cases, competitive advantages
I presented an overview of IBM Spectrum Scale v4.2.1 release. I covered our support for POSIX, NFS, SMB, Hadoop, OpenStack Swift and Amazon S3 interfaces.
IBM Spectrum Scale is an ideal solution to replace NetApp filers, EMC Isilon or DataDomain storage devices. Use cases include clustered NAS, Object store, and Hadoop repository for analytics.
IBM Spectrum Archive -- Integration with Spectrum Scale, and its Applications in CCTV and Media
This was another special request from the UAE team, and I had a lot of fun putting it together. I started talking about IBM's recent acquisitions in video technologies, including LiveStream and ClearLeap.
I then explained how Spectrum Scale works, and how Spectrum Archive works either separately, or in combination with Spectrum Scale.
A live demo was planned to show this all off, but sadly I had network, firewall and/or VPN issues that prevented me from attaching to my Tucson-based systems. I then wrapped up with client references that have successfully used IBM Spectrum Archive in this area.
IBM Virtual Storage Center - Prepare your existing storage for the future
Mike Griese presented IBM Virtual Storage Center, which combines the "Control Plane" product of IBM Spectrum Control Advanced Edition, with the "Data Plane" products under IBM Spectrum Virtualize.
Introduction to Object Storage and its Applications - Cleversafe
I presented the basics of object store, a radical new way of storing information and how it is different from block or file-based storage alternatives.
I then covered the features of IBM Cleversafe solutions, available as software, pre-built appliances, and in the Cloud. I wrapped up with practical use cases for Content Repository, Enterprise Collaboration, Active Archive, Storage as a Service, and Backup storage pool.
Integration between IBM Spectrum Scale and Cleversafe
This was a fun session.
I presented an overview of IBM Spectrum Scale which provides volume, file and object-level storage interfaces on data that can span various flash, hybrid and spinning disk storage devices.
I gave a quick recap of Cleversafe for those who missed my earlier session.
I then showed how files can be migrated from IBM Spectrum Scale to either Cleversafe on-premises, Cleversafe in the Cloud on IBM SoftLayer, or LTFS-enabled tape using Spectrum Archive, or to any combination of disk, tape, object storage, Cleversafe and Cloud through IBM Spectrum Protect HSM and Space Management features.
Tuesday evening I went out to dinner with the z Systems team. Earlier in my career, I was the chief architect of DFSMS, the storage management element of z/OS operating system, so I continue to have close ties with the folks from Poughkeepsie.
Was Dubai too far away for you to attend? Want to hear the latest technical information about IBM Storage, but not willing to wait until the big [IBM Edge Conference] this September? We will have several more "IBM TechU Comes to You" events in May and June.
According to Gartner data (from 2005!), host-based storage accounts for 34 percent of the overall market for external storage, with the remaining 66 percent going to "fabric-attached" (network) storage, expect this share to grow from 66 percent to 77 percent by 2007.What is the current reality? SAN vs. NAS, FC vs iSCSI?
IBM subscribes to a lot of data from different analysts, they all have their methods for collecting this data, from taking surveys of customers to reviewing financial results of each vendor. While theymight not agree entirely, there are some common threads that lead one to believe they represent "reality". Hereare some numbers from an IDC December 2007 report:
Worldwide Disk Storage
While the 32/68 split is similar to the 34/66 split you mentioned before, you can see that external growth isgrowing faster, so internal host-based storage will drop to 25 percent by 2011, with external storage growing to 75 percent, very close to the 77 predicted. Looking at just the externaldisk storage, there are basically three kinds: DAS (direct cable attachment), NAS (file level protocols suchas NFS, CIFS, HTTP and FTP), and SAN (block-level protocols like FC, iSCSI, ESCON and FICON):
Worldwide External Disk Storage
At these rates, fabric-attached (SAN and NAS) will continue to dominate the storage landscape.Looking more closely now at the block-oriented protocols.
Worldwide External Disk Storage
Fibre Channel (FC)
At these rates, iSCSI will overtake FC by 2011. IBM System Storage N series, DS3300 and XIV Nextraall support iSCSI attachment.
Jon Toigo over at DrunkenData offers some additional data from ex-STKer:[Fred Moore Outlook on Storage 2008]. I met Fredat a conference. He had left STK back in 1998, and started his own company called Horison. NeitherJon nor Fred cite the sources of his statistics, but the following comment leads me to assume hehasn't been paying attention closely to the tape market:
With the demise of STK, who will be the leader in the tape industry?
Depending on how old you are, you might remember exactly where you were when a significant eventoccurred, for example the[Space Shuttle Challenger]explosion. For many IBMers, it was the day our friends at Sun Microsystems announced they were [puttingour lead tape competitor out of its misery]. I was in New York that day, but there was still someconfetti on the floor in the halls of the IBM Tucson lab when I got home a few days later. IBM hasbeen the number one market share leader in tape for over the past four years.
Well it's Tuesday again, and you know what that means? IBM Announcements!
You might be thinking, didn't IBM just have a [huge storage announcement October 8, 2013]? You would be right! IBM's $1B additional investment in Storage has been like shot of adrenaline in getting new features and functions out sooner to our clients.
DS8870 Disk System Release 7.2
New IBM POWER7+ controllers. The previous models of DS8870 were based on the POWER7 controllers, and these new models have POWER7+ processors. This change enhances the performance across the board, from mainframe to distributed systems, from sequential to random. Customers with existing POWER7-based models will be able to do MES upgrade to the new POWER7+ next year.
For comparison with older DS8000 models, here are some internal IBM measurements we took for Database workloads on both z/OS(mainframe) and Distributed systems with typical 70% read, 30% write and 50% cache hit:
IBM Internal Measurements (thousands of IOPS)
DB Distributed systems
New 1.2TB (10K RPM) and 4TB (7200 RPM) self-encrypting enterprise drives (SED). This is a 33% boost over the previous 900GB and 3TB drives previously available. As with all the other drives in the DS8870, these new drives include the encryption chip right on the drive itself, offering encryption with scalability.
Improved security. Release 7.2 will support the U.S. National Institute of Standards and Technology [NIST.gov]] 800-131A specification, raising the 96-bit encryption to the required 112 bits on the customer IP network. This involves updates to the security firmware, management software and digital signatures on code loads.
Metro Mirror enhancement for System z. By avoiding serial conflicts of updated blocks, this enhancement can boost performance up to 100 percent when using Metro Mirror with z/OS applications on System z mainframes.
Easy Tier™ reporting and graphs to determine optimal mix. Now you can see for yourself how sub-LUN automated tiering is helping your applications.
Easy Tier Workload Categorization
New workload visuals help clients and IBM technical specialists compare activity across tiers within and across pools to help determine optimal drive mix for current workloads
Easy Tier Data Movement Daily Report
New Easy Tier summary report every 24 hours illustrating data migration activity (5-minute intervals) can help visualize migration types and patterns for current workloads
Easy Tier Workload Skew Curve
Shows skew of all workloads across the system in a graph to help clients visualize and accurately tier configurations when adding capacity or a new system Clients can import data into Disk Magic
All-Flash Optimization. Yesterday, in my post [IBM FlashSystem versus EMC XtremeIO], I mentioned that any hybrid systems like the IBM Storwize V7000 that can support a mix of SSD and HDD can obviously be configured as SSD-only. Apparently, that was not obvious to many readers, so I apologize. For the DS8870, you can configure an all-Flash (SSD only) configuration, and Release 7.2 added some optimization when configured with SSD only.
1,056 drives 15K @146GB in RAID-10
224 drives SSD @400GB in RAID-5
Same - Usable 72 TB
70 percent faster
33 percent less floor space required
62 percent less energy consumed
(Note: Performance results based on measurements and projections using IBM benchmarks in a controlled environment.)
OpenStack™ support DS8870 now offers the [OpenStack Cinder] interface for block LUN allocations in OpenStack environments. IBM is a Platinum sponsor of OpenStack, and Opentack is the strategic platform for IBM private and hybrid clouds.
XIV Storage System
Following on the heels of the [XIV enhancements announced], IBM has now added 800GB Solid State Drives (SSD) as Read cache for its 4TB drive-based models.
DCS3860 Disk System
The DCS3860 is the next generation of the DCS3700 disk system. Designed with Linux-x86 servers in mind, the system offers direct SAS host attachement, 24GB of cache, and 60 drives in a compact 4U drawer. Like its predecessor, the drives are stored on five pull-out trays, with twelve hot-swappable drives per tray. You can add up to five more expansion units, with 60 drives each, for a total of 360 drives in 24U rack space.
These new models will help our clients deploy new workloads and consolidate existing workloads.