This blog is for the open exchange of ideas relating to IBM Systems, storage and storage networking hardware, software and services.
(Short URL for this blog: ibm.co/Pearson )
Tony Pearson is a Master Inventor, Senior IT Architect and Event Content Manager for [IBM Systems for IBM Systems Technical University] events. With over 30 years with IBM Systems, Tony is frequent traveler, speaking to clients at events throughout the world.
Lloyd Dean is an IBM Senior Certified Executive IT Architect in Infrastructure Architecture. Lloyd has held numerous senior technical roles at IBM during his 19 plus years at IBM. Lloyd most recently has been leading efforts across the Communication/CSI Market as a senior Storage Solution Architect/CTS covering the Kansas City territory. In prior years Lloyd supported the industry accounts as a Storage Solution architect and prior to that as a Storage Software Solutions specialist during his time in the ATS organization.
Lloyd currently supports North America storage sales teams in his Storage Software Solution Architecture SME role in the Washington Systems Center team. His current focus is with IBM Cloud Private and he will be delivering and supporting sessions at Think2019, and Storage Technical University on the Value of IBM storage in this high value IBM solution a part of the IBM Cloud strategy. Lloyd maintains a Subject Matter Expert status across the IBM Spectrum Storage Software solutions. You can follow Lloyd on Twitter @ldean0558 and LinkedIn Lloyd Dean.
Tony Pearson's books are available on Lulu.com! Order your copies today!
Safe Harbor Statement: The information on IBM products is intended to outline IBM's general product direction and it should not be relied on in making a purchasing decision. The information on the new products is for informational purposes only and may not be incorporated into any contract. The information on IBM products is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. The development, release, and timing of any features or functionality described for IBM products remains at IBM's sole discretion.
Tony Pearson is a an active participant in local, regional, and industry-specific interests, and does not receive any special payments to mention them on this blog.
Tony Pearson receives part of the revenue proceeds from sales of books he has authored listed in the side panel.
Tony Pearson is not a medical doctor, and this blog does not reference any IBM product or service that is intended for use in the diagnosis, treatment, cure, prevention or monitoring of a disease or medical condition, unless otherwise specified on individual posts.
The developerWorks Connections platform will be sunset on December 31, 2019. On January 1, 2020, this blog will no longer be available. More details available on our FAQ.
Over time, I have gotten many emails, comments and tweets related to this post. The instructions have been downloaded over 130,000 times!
The letter below was so inspiring that I felt I need to share it. (Published here with permission from the author, who goes by the screen name DaveAlex)
Thought you would like to know that I am working toward an AI Agent hopefully more advanced than "Watson Jr." although I will probably include the software behind it.
The hardware I have on hand is a System X3650M2 which I bought for $250 on eBay. It has four 2.66 GHz Xeons with 6 cores each, and 16 GB RAM. I have another 16 to install when I need it. I will shortly have 4 TB of HDD space on line, plus an addition 3 TB USB3 drive.
Ultimately, I hope to have some of the available knowledge bases on line, Freebase, CYC, etc which will handle specific information perhaps better than the Watson software by itself.
What the target (goal) that I am aiming for is a stationary version of Commander Data of Star Trek, Next generation.
I envision if having some form of self knowledge, being capable of processing graphical data, i.e., facial recognition, gesture interpretation, voice input/output, mathematical processing, with graphical output (display & hardcopy) and several additional features.
As I have studied this project, I am amazed at how much of the required software is already available. The biggest stumbling block is integrating the separate parts.
Back to Hardware. I just bought 2 Dell 2850 servers, each with dual Intel Xeons which can handle some of the tasks. If I need more processing power, I just happen to have about 10 other towers with Pentium IV or dual core processors sitting around, which can be pressed into service as needed. So far, my total cost is less than $1000 US Dollars, and my wife has not thrown me out yet. I continue to watch eBay for additional older used equipment for fractions of the original cost. My friends who follow my project keep telling me that I need to get on with the software, and add hardware as needed; they are absolutely correct, but I can't resist a bargain.
The power consumption is a potential problem, but I have a 4500 Watt solar array to use. The cooling could be a problem too, but my house sits into the side of hill, and can readily duct the air supply pass the sub-surface wall, perhaps with old Processor cooling fins glued to the wall.
I hope to get some hobby programmers involved in the project, it is a bit beyond my programming capabilities. I hope that I can live long enough to see it come to fruition; I am 78 now, and mentally in very good condition.
Wow! He is 78 years old! While others his age are playing shuffleboard at the nursing home, he is out there learning new things about the latest technology. I wish him the best of luck on this! If you would like to reach out to DaveAlex, send me a note or comment below, and I will forward them on to him.
Continuing my coverage of the [IBM Edge2014 conference], IBM's premiere conference for System Storage and related products, I attended keynote sessions on Tuesday morning, titled "Delivering on the Promise of the Future: Made with IBM".
Once again, Stephen Leonard, IBM General Manager, STG Sales, served as emcee for this general session. Yesterday, the executives focused on the "What" and "Why" for new IT initiatives. Today, they want to tackle "How" to accomplish all this.
Robert LaBlanc, IBM Senior Vice President, Software and Cloud Solutions
Robert estimates that 70 percent of enterprises will pursue dynamic hybrid clouds by 2015. Big data and analytics represents a $17 trillion USD opportunity, about 25 percent of the total IT industry.
IBM helps companies extend what they already have to what they need. In the future, people will ask "Who remembers building a private cloud stick-by-stick?" Today, IBM supports the deployment of patterns of expertise that can work on-premise IBM PureSystems. These can easily be moved or deployed off-premise to IBM SoftLayer private and public cloud offerings.
Snehal Antani, CIO of GE Capital
IT has shifted from the "back office" to the very core of business. Technology now allows GE Capital to go quickly from whiteboard to roll-out.
Not everyone is on-board. At GE Capital, people are encouraged to be like [Tigger", the adorable character from Winnie the Pooh stories, to lead efforts of innovation and collaboration. Cynics are tagged as [Eeyores], always finding a reason or excuse why plans won't work. Finally, we have "Kings and Queens", eager to be offended that any changes are needed at all.
Snehal also mentioned their "No squirrel" policy. If you have seen the movie "Up!", you know that the dog was constantly distracted by squirrels, or things he thought were squirrels. Many IT people fall the latest "shiny object" in technology.
Arvind Krishna, IBM General Manager of Development and Manufacturing
Arvind feels that "data" is the new base of new business value, in the same manner as steam, electricity and hydrocarbons had done in past centuries. In the past, most data was stored in databases, but today over 90 percent is unstructured.
In 2008, there were more "things" than people attached to the Internet, and this [Internet of Things] is expected to exceed 1 trillion items by 2015.
Have you ever wondered how the NFL plans each year's football game schedule, balancing 32 teams across five television networks? There are over 800 quadrillion possible combinations!
Borrowing the analogy from Snehal from GE Capital, the football teams are the Eeyores, and the networks are the Kings and Queens. This year, three of the games will be played in London, England. With IBM's help, the NFL was able to finish the 2014 schedule earlier than before.
Maria Winans, IBM Vice President, Social Business
Maria started with an interesting anecdote:
Lily Robinson, age 3, sent a letter asking a local grocery chain Sainsbury why their "tiger bread" was not called "giraffe bread" as it looked more like the spots on a giraffe. A manager provided a nice reply. Her parents posted it on social media, the conversation went viral, and [Sainsbury changed the name of their product] to "giraffe bread".
This is an example of "People-centric" engagement, rather than dealing with consumers in marketing segments or categories of gender or race. People will share personal data with companies they trust. Smarter companies use this data to provide the right experience at exactly the right time.
Maria explained IBM AlwaysOn Engagement Center which allows companies to track social mentions. For example, there were over 52 million social mentions of IBM Edge 2014 so far during its first two days!
The process is not just for clients, customers and consumers. It can be used to engage individual employees to drive business outcomes, or individual citizens to deliver sustainable economic growth and improve living standards.
This was a nice balance, combining IBM executives with client testimonials.
For those on Twitter, my handle is @az990tony and the hashtag for this event was #ibmedge.
Continuing my coverage of the [IBM Edge2014 conference], IBM's premiere conference for System Storage and related products, I attended EdgeTalks: Innovation That Impacts Our World that offered a series of inspiring talks styled after the famous [TED] conferences.
Surjit Chana, IBM Chief Marketing Officer (CMO) and VP of Strategy for IBM Systems and Technology Group, served as emcee to introduce the speakers.
Ron Finley, Renegade Gardener
Back in 2003, "South Central" was [renamed to South Los Angeles]. But as everyone in IT knows, merely renaming something doesn't fix any of its problems. Ron was tired of seeing empty lots filled with old mattresses, used condoms and discarded tires, and wanted to beautify his immediate surroundings by planting vegetables in his front yard.
Ron's army of volunteers, the [L.A. Green Grounds], filed a petition. As of October 2013, it is now legal to grow food on your parkway in Los Angeles.
Ron explained that South Los Angeles is a [food desert], where it is nearly impossible to get healthy, organic food. He is concerned the "drive-thrus" of fast food restaurants kill more of his neighbors than [drive-by] shootings.
Ron has discovered this problem is not limited to Los Angeles. The American food system is designed to fill you with processed food and chemicals, made worse by a health care system happy to cut you open or prescribe you more chemicals and drugs. Everywhere processed food goes, chronic disease follows. The USA exports obesity to the rest of the world.
"To change a community, and you must first change the composition of the soil." -- Ron Finley
The rise in cancer, diabetes, and childhood cardiac arrests inspired Ron to start the [Ron Finley Project] consisting of community farms, a marketplace that accepts EBT, SNAP and other government food programs, and portable "container cafes" based on standard shipping containers that could be placed near a garden to help sell the food grown locally.
John Wilbanks, Chief Commons Officer at Sage Bionetworks and Senior Fellow in Entrepreneurship for Faster Cures
We live in the age of cheap data. John prefers the term "cheap data" rather than "big data". Mapping the first human genome cost $3 Billion USD, now John can get his own genome mapped for about $1200.
John feels this cheap data changes the way we justify our opinions. From baseball scouts to the analytics demonstrated in the movie [Moneyball]. President Barack Obama used social media to help win elections. And cheap data is coming to health and medicine.
John gave an interesting example. A grad student wanted to study alcoholism among undergraduate students. The traditional method would have been to gather privacy permission slips from volunteers. Instead, he "friended" 4,000 undergraduates, and looked on social media containing the [distinctive color of red beer cups] for photos taken on Monday through Wednesday, indicative of a drinking problem. This innovative approach allowed the grad student to complete his research in less than six weeks.
Cheap data doesn't mean we have wisdom. John explained the wrong way of doing things. There are several machine-learning apps for smartphones to check for melanoma. Take a photo of your suspected mole, and the app will determine if it detects skin cancer, and recommend a biopsy. Incentives to sell apps, and to perform biopsies, result in 90 percent false positive rates. There is no financial incentive to improve accuracy.
Sharing is the innovation that converts cheap data into wisdom. Get the world's smartest people to compete to create wisdom. Collaborating with IBM on Dialogue for Reverse Engineering Assessments and Methods [DREAM] platform, a competition for modeling breast cancer was launched. Requiring all participants to share their code in real-time allowed the accuracy of the model to jump three orders of magnitude in just nine days. Over 60 teams participated. The winning team was awarded an article and cover of [Science Translational Medicine] magazine.
John feels that there are very few genius [data scientists] in the world, and they are isolated, hideously overpaid, managing hedge funds or search engines, but would probably rather be looking for cures for cancer.
Progress is not made if every company only has its own people looking at its own data. John wants data to shared amongst the world's scientists to create wisdom. However collaboration flies in the face of the competition that all the reward systems are based on in health care.
As an experiment, John wanted to make his own genome public. However, that requires "informed consent" for others to use his private health information, and it took him six months of legal and ethical rules to develop a system for him to provide this consent for public use.
In much the same way that gardens and fields were the first [commons] shared by farmers, John feels we need to cultivate the public domain, the "digital commons". This can truly transform medicine and health care.
Peter Singer, Technology Expert and Best-selling Author
The first web page appeared in 1991, and now there are over 30 trillion pages. Over 98 percent of military communications occur over civilian internet communications. The [Internet of Things] adds everything from smart cars to medical devices into the equation.
But along with all the benefits the web has brought society, there are also risks. Every second, nine new pieces of malware are discovered. An astounding 97 percent of Fortune 500 have admitted to being hacked. Over 100 governments have established a cybermilitary force.
(Instead of Powerpoint slides, Peter had a slideshow of his personal collection of the world's best and worst cybersecurity art. Studies show that audiences remember 60 percent more if they are looking at pictures when they hear a speaker.)
While IT folks are good at dealing with both hardware and software, they traditionally don't do well with "wetware", the human side of things. Essential cybersecurity terms and concepts are often misunderstood.
Business leaders over-react to some threats, but completely ignore others. Consider that 70 percent of cybersecurity decisions at companies are made by executives who have no training in cybersecurity. No single MBA program offers cybersecurity courses.
There is a shortage of talent to deal with cybersecurity. Hiring managers are only satisfied with 40 percent of the employees they hire in this Cybersecurity space.
Incentives help explain why some industries like financial services do security well, while others like health care do poorly.
In an effort to find which employees do not take cybersecurity seriously enough, Companies have resorted to sending [phishing] emails to their own employees. Those that click are caught, and must attend mandatory training, or are subject to dismissal. Unfortunately, senior executives are twice as likely to click on phishing emails than the general workforce.
Peter recommends companies focus on resilience. You can never build high enough walls to eliminate threats. Instead, focus on bouncing back after attacks, similar to the anti-bodies in the human body deal with illness.
Ben Franklin said that an ounce of prevention is worth a pound of cure. Peter cited a studied that found proper cyberhygiene would have prevented 94 percent of attacks. The most successful foreign military attack on the U.S. military happened when a soldier saw a memory stick in a parking lot, and was curious enough to connect it to the secure military network to see what it contained.
We need to build an ethic. We teach our kids to cover your mouth when you cough. This does not protect your child in any way, but is an ethic to avoid spreading disease. We need to teach the same ethics related to cybersecurity.
All three were excellent talks focused on innovation. Ron Finley used gardening in otherwise empty urban spaces to help grow people as well as food. John Wilbanks used innovation to help bring the smartest minds to determine models for identifying cancer from genomes. Peter Singer marveled at the innovation of the Internet, and how proper cyberhygiene is needed to keep it secure.
These talks were recorded and available on this [98-minute YouTube video]. For those on Twitter, my handle is @az990tony and the hashtag for this session was #ibmedgetalks.
Continuing my coverage of the [IBM Edge2014 conference], IBM's premiere conference for System Storage and related products, here are my notes from the afternoon of Day 1 at the general keynote sessions.
Stephen Leonard, IBM General Manager, STG Sales, served as emcee for the general session.
Tom Rosamilia, IBM Senior Vice President, STG and ISC
Tom (my fifth-line manager, BTW) started off with a joke: "All this talk about Cloud, but it has to run on hardware somewhere!"
Tom insists it is imperative for clients to build an infrastructure that enables business growth. However, less than 10 percent of clients are ready for Cloud, Analytics, Mobile or Social (CAMS) initiatives. Clients need to embrace these new workloads, ensure right-time decision making, and integrate front-office with back-office IT systems.
Tom is also proud that IBM's Software Define Storage solutions manage over 1 [Yottabyte] of information today. That's a billion Petabytes, in case you were wondering. If all of this data was stored on 1TB disk drives, instead of a mix of disk and tape, it would take over one million city blocks to house all the data centers required.
Tom indicated that data is to the 21st century what steam was for the 18th century, electricity was for the 19th century, and hydrocarbons were for the 20th century.
Tom invited Mike Reagan, CIO of Cleveland Clinic in Abu Dhabi, to say a few words on why Infrastructure matters to his IT environment. The [Cleveland Clinic in Abu Dhabi] is a 364-bed multi-specialty facility, the first US-hospital replicated outside of North America.
Mike explained their great success partnering with IBM to develop a private cloud solution. Each patient has a bedside tablet that can be used to control the entertainment, lighting, temperature and window shades. It can also be used to Skype with family and friends. The facility is four times the floorspace of the Sands Expo that this event is being helenovo 61 CES awardsld in.
Jamie Thomas, IBM General Manager, Storage and Software Defined Systems
Jamie feels that data is all about security and economics. Storage admins must become the new [data scientists] for IT.
It is important to integrate traditional "Systems of Record" with new "Systems of Engagement" workloads. Her focus areas are Software Defined Storage, Flash technologies, and storage virtualization. Specific examples included:
Mike talked about how important Electronic Health Record [EHR] systems and advanced clinical diagnostics are to help make the right medical decisions.
Greg explained that Citi was operating at global scale in 100 countries. Citi partnered with IBM to deploy commodity compute servers, 10GbE/40GbE Ethernet networking and IBM Software Defined Storage to achieve Cloud economics and Cloud scale. Citi can't afford for server, storage and network admins to work separately.
Rather than contesting [Hewlett-Packard CEO Meg Whitman's FUD about this deal], Adalio took the high road, and focused on IBM's success in the x86 server space. New offerings include the X6 architecture, including PureSystems and the NextScale dense computing platform.
Adalio invited Christian Teismann, Lenovo, on stage. Christian re-iterated that IBM and Lenovo are both committed to a smooth transition, continuing IBM's roadmap for the x86 server platform, and full consideration for the x86 servers and related storage, software, service and maintenance.
IBM has had a strong relationship with Lenovo already with the acquisition of IBM's PC division, and now this deal brings together Chinese supply chain efficiency with Western ideals and design principles. Lenovo has about 46,000 employees, nearly 4,000 R&D engineers, and will acquire an additional 7,500 IBMers when the deal completes.
Adalio then invited two clients to join him on stage: Ron Grabyan, Manager of Data Warehousing Services at [Southern California Edison], and Rohit Lal, IT Direction of Coca-Cola.
Ron indicated that actionable insights must be fast for productivity. He mentioned the funny [MetLife television commercial featuring Charlie Brown and Lucy] declaring that term-life insurance should cost only "five cents" per month. In the same manner, end users often request that response times should be short. IBM was able to get response times from 40 seconds down to "5 seconds" by helping Ron deploy SAP HANA. Another process that took 53 minutes was down to 1 minute 20 seconds.
Rohit talked about their exciting new "Coke One North America" (CONA) project. This will provide consolidated IT services for 6 different Coca-Cola bottlers in North America. With $46 Billion USD in revenue serving 1.8 billion servings of beverage per day, the use of Analytics, SAP HANA and private cloud were critical to their business.
The industry recognizes Lenovo as a major x86 player, having had 20 quarters of growth outpacing the market. Lenovo has [won 61 CES 2014 awards], more than the other top five x86 vendors combined. IBM x86 servers are ideal for Enterprise solutions, Cloud, HPC, embedded designs, and IT infrastructure deployments. IBM is #1 in x86 server customer satisfaction, #1 in x86 server up-time, and boasts the #1 fastest x86-based supercomputer. IBM and Lenovo want to take this to the next level: #1 leadership in every x86 category.
For those on Twitter, my handle is @az990tony and the hashtag for this event is #IBMEdge.
Continuing my coverage of the [IBM Edge2014 conference], IBM's premiere conference for System Storage and related products, here are my notes from the morning of Day 1.
IBM Storage Trends and Directions
Clod Barrera, IBM Chief Technical Strategist for IBM System Storage, and Axel Koester, IBM Chief Technologist and Executive IT Specialist for IBM System Storage, co-presented the first session of the conference.
Nearly all storage users are struggling with the combined effects of significant capacity growth, data as both an asset and potential liability, and the lack of staff and expertise to exploit new technology.
In addition to [Systems of Record], representing the traditional workloads of databases and on-line transaction processing (OLTP), we are now seeing [Systems of Engagement], which represent new workloads such a mobile apps, social business, and big data analytics.
We are now at a tipping for Flash. IBM FlashSystem can perform I/O in about 100 microseconds, which is roughly 10x faster than solid state drives (SSD), and 50x faster than spinning disk. For those clients who value performance, this can easily justify its use.
Take for example an IBM Power system running DB2 PureScale application with 43,000 transactions per second, including 13,000 updates per second, that result in 1.3 million IOPS to the back-end storage. This can be accomplished with either (a) all-disk 5,000 spinning disk spindles, (b) hybrid 2,500 spinning disk spindles combined with 128 solid state drives (SSD), or (c) IBM FlashSystem.
The comparisons are astounding. The IBM FlashSystem solution is 11x less expensive then the hybrid system, and 14x less expensive than the all-disk solution. The solution also uses 26x less energy, and 80x less space in the data center.
Clod also feels that Software Defined Storage has come of age. IBM has three offerings in this area. The first, code-named Elastic Storage, represents IBM's General Parallel File System (GPFS) and GPFS-based products like SONAS and Storwize V7000 Unified. The second is the IBM SmartCloud Virtual Storage Center and Storwize family of storage hypervisors. The third is IBM XIV Storage System.
Software Defined Storage can be used in private, hybrid and public clouds. In 2013, only 22 percent of storage was Cloud, but this is expected to grow to 50 percent by 2017.
IBM will support a range of Software Defined Environments, from the highly proprietary VMware, to the open source OpenStack foundation. Where applicable, IBM will provided added value above and beyond the basic OpenStack infrastructure.
Axel Koester presented storage futures. He works closely with IBM Research and described some of the projects they are working on:
120PB file system solution that involved a grid of IBM POWER 775 servers. Instead of traditional RAID, the system used GPFS Native Raid, which offers an 8+3 Reed Solomon protection scheme.
Multi-cloud storage that allows you to access storage from multiple public providers without having the bottleneck of a single master scheduler.
Phase Change RAM (PCRAM) which does not rely on capturing an electrical charge. This will be 12x faster than PCIe Flash, and 275x faster than consumer SSD.
Liquid state storage. Rather than solid state, metal is kept in its liquid state to store binary information.
Finally, he mentioned IBM Research's success at storing a single bit of information in just 12 atoms. To do this, the folks at Almaden Research Center had to manually move the atoms into place using the needle of a scanning tunneling microscope [STM] to nudge each atom into position.
Axel gave a great example of scale. An atom compared to a tennis ball is like a tennis ball compared to the entire planet Earth. If an atom was the size of a tennis ball, the point of the STM needle would be the size of Mount Everest, but upside down.
IBM's Smarter Storage Strategy
In previous years, my session on Storage Strategy was scheduled on Wednesday or Thursday, and attendees would comment "Why wasn't this sooner in the week? Everything makes more sense now!"
This time, I was featured immediately after Clod and Axel's keynote session, resulting in hundreds of attendees in a large standing-room-only ballroom. The session was repeated Thursday morning for those who were turned away.
IBM's storage strategy has three main themes.
First, IBM is focused on data-intensive solutions such as big data analytics. This means storage needs to be efficient to manage the growth in a cost-effective manner. IBM offers real-time compression and data deduplication to be capacity-efficient, Flash, Nearline drives and tape to be energy-efficient, and extremely easy-to-use graphical user interfaces and automation to be labor-efficient.
Second, IBM wants to optimize business critical workloads. IBM wants to eliminate the manual effort needed to balance between performance versus cost. IBM Easy Tier, I/O priority manager, and FlashSystem solutions are just a few examples.
And third, IBM wants to help you start quickly, and add value, by deploying private, public and dynamic hybrid cloud environments. IBM is not limiting its solutions to just VMware, but rather supporting other server hypervisors including KVM, Hyper-V, PowerVM and z/VM. IBM is a platinum sponsor for OpenStack foundation, and IBM storage systems support Cinder interfaces.
For those on Twitter, my handle is @az990tony and the hashtag for this event is #IBMEdge.
When IBM designed the DS8870, it changed the bulk power supplies and batteries used in the previous DS8800 model to highly energy-efficient [DC-UPS]. In addition to reducing the overall energy consumption of the DS8870, it also gave the engineers space above the units to put 4U of standard 19-inch rack equipment.
The High Performance Flash Enclosure provides an ultra-dense and ultra-high-performance option. Each HPFE can delivers up to 250,000 IOPS and up to 3.4 GB/s bandwidth.
Up to thirty 387 GB Enterprise Multi-Level Cell (eMLC) flash cards provide up to 11.6 TB of raw capacity, about 9.2 TB usable, in only 1U of 19-inch rack space. A pair of very powerful integrated SAS RAID engines manage RAID-5 across the flash cards. The HPFE attaches directly to GX++ slots in the two DS8870 POWER7+ controllers, rather than using the Device Adapter (DA) loops.
You can have up to four of these HPFE in the "A" frame of your DS8870. Each HPFE can have either 16 or 30 flash cards. For 16 cards, you would have two spare plus two 6+P RAID-5 ranks. For 30 cards, you would add another two 6+P RAID-5 ranks.
Easy Tier Enhancements
Easy Tier is IBM's market-leading sub-volume automated tiering inside the DS8870 disk system. There were several enhancements in this announcement.
The first enhancement is to "Easy Tier Server", a feature that coordinates caching of active blocks of data inside the server's own internal Flash. This had supported Power Systems with EXP30 Ultra drawers, and now expanded to support IBM [Flash Adapter 90].
The second enhancement is to the three-level (Flash,Enterprise,Nearline) tiering algorithm. Inside the DS8870, the new HPFE flash cards will be part of the "Flash Tier" along with solid state drives (SSD) attached to the DA loops. Internal inter-tier load-balancing will take into account the faster nature of the flash cards in the HPFE, and move the busiest blocks accordingly. We we refer to this as "micro-tiering" within the Flash Tier.
Broader Solid State Drive options
Not everybody likes the 400GB solid state drives IBM offered for the DA loops, so IBM is now offering a smaller 200GB and a larger 800GB options as well.
Enhanced Concurrent Code Load
The new DS8870 R7.3 firmware release drastically cuts the activation time of concurrent code load in half.
Nobody likes warmstarts either. These are a necessary evil for some error conditions, but the clever engineers upstairs have figured out ways to reduce the number of warmstarts and eliminate the need to perform a warmstart after certain events to prevent any application impact to the attached host.
Multi-Target Remote Mirror
By now you know that IBM has the market-leading remote mirroring services for high-end disk systems, using less bandwidth and maintaining better concurrency than high-end systems from other vendors.
The DS8870 R7.2.7 firmware release can now support multi-target remote mirror. In previous releases, if you wanted three-site disaster recovery, you relied on Metro/Global Mirror, where site "A" had a Metro Mirror to a bunker site "B", and then site "B" had a Global Mirror to site "C". Not everybody liked this.
Some clients have asked for a "star" configuration, where "A"-to-"B" and "A"-to-"C" are independent of each other. A SCORE request is available for the following configurations:
Two Metro Mirror
One Metro Mirror and one Global Copy
Two Global Copy
While Metro Mirror can support up to 300km distance, and Global Copy can go any distance around the planet, there is no reason why you can't have one or both copies in the same building, or on campus nearby, for use with HyperSwap.
OpenStack Cinder interface support
Last but not least, the DS8870 now offers full support for OpenStack Havana and Icehouse releases. Support is provided through the OpenStack Cinder driver currently available for download. IBM is a platinum sponsor of the OpenStack foundation.
International Technology Group [ITG] has just published a series of papers about IBM SmartCloud Virtual Storage Center (VSC) and SAN Volume Controller/Storwize storage hypervisor virtualization technology detailing the cost benefit advantages over EMC and VMware.
IBM delivers up to 72% lower storage TCO than EMC storage virtualization and management solutions in large enterprises ... and up to 35% lower storage TCO than VMware tools in mid-sized environments
Also, you can watch an interview with the study's author, International Technology Group Managing Director, Brian Jeffery, live from next week's IBM Edge Conference in Las Vegas. Brian will be interviewed on [TheCUBE by Wikibon] on Monday afternoon. Watch it live on May 19!
I will be at Edge next week. If you plan to be there, I would be glad to discuss these ITG findings with you and your clients in person.
Jamie Thomas, IBM General Manager of Storage and Software Defined Environments
Jamie announced [IBM Elastic Storage], a new offering that is available as a software defined storage solution, based on IBM's General Parallel File System (GPFS) technology already deployed at 45,000 installations.
IBM Elastic Storage provides a global name view across data center locations. It can manage up to a Yotabyte of information, combining Flash, disk and tape resources. It supports OpenStack interfaces, Hadoop and standard POSIX file system conventions.
IBM Elastic Storage provides automated tiering to move data from different storage media types. Infrequently accessed files can be migrated to tape and automatically recalled back to disk when required. Unlike traditional storage, it allows you to smoothly grow or shrink your storage infrastructure without application disruption or outages.
IBM Elastic Storage software can run on a cluster of x86 and/or POWER-based servers, and can be used with internal disk, commodity storage, or advanced storage systems from IBM or other vendors.
IBM partnered with various clients in different industries in a special beta program. Jamie led a client panel to discuss their experiences with IBM Elastic Storage:
Alan Malek, Director of IT, Cypress Semiconductor.
"Total cycle time is key". Over the past 31 years, they bought whatever file storage was available. Now, with IBM Elastic Storage, the performance was very consistent for their engineering workloads with full load balancing.
Russell Schneider, Principal Storage Consultant, Jeskell.
Russell's company works with a lot of federal agencies, "Big Data has become Bigger Data". For example, research on Global Warming and Climate Change requires a large amount of storage across agencies.
In another example, when the tsunami hit Japan a few years ago, an agency here in the USA realized they had 14PB of data stored as a single copy in a data center at sea level less than a mile from the coast. They realized they needed to have a secondary copy, and an option to cache to a third location depending on regional disasters.
Matthew Richards, Products, OwnCloud.
For those not familiar with OwnCloud, it provides a Dropbox-like file sharing service, but in the Enterprise, with on-premise storage. It has been fully tested and certified with IBM Elastic Storage to provide a secure file sharing platform.
With IBM Elastic Storage, they were able to scale linearly up to 20,000 users, and are now testing 100,000 users. The need to have intelligent access to files at scale is what Matthew likes about IBM Elastic Storage.
Dr. Michael Factor, IBM Distinguished Engineer at IBM Research
Michael started out explaining there are three areas for storage: block, file and object. The fastest growing type of data is unstructured fixed content with associated metadata. This is ideal for object storage. Michael has been working with OpenStack Swift, an open source interface defined for object storage. He defined "storlets" as follows:
Storlets extend an object store by moving computation to the data -- filtering, transforming, analyzing -- instead of bringing data to the computation.
Storlets have been deployed on a variety of European Union research projects. For example, in partnership with Phillips, a pathology storlet can count the number of cancer cells in an image. By bringing the computation to the data, it eliminates having to transfer large amounts of data over the network.
Storlets can run on-premise and on IBM's SoftLayer IaaS cloud offering.
Bruce Hillsberg, IBM Director of Storage Systems at IBM Research
Bruce led another panel discussion, this time of IBM storage experts:
Vincent Hsu, IBM Fellow and CTO of Storage.
The problem is the isolation of data into "storage silos". Isolation causes problems in managing large amounts of data at scale, and costs more as storage is not fully utilized. IBM Elastic Storage brings everything together, eliminating storage silos.
Michael explained how IBM works with clients all over the world to ensure that storage solutions meet client requirements. For example, storlets can be used to use rich metadata to manage photographs, and display them based on GPS satellite location, or other content that makes it easier to manage these images.
IBM Elastic Storage will support OpenStack Cinder and Swift interfaces. IBM is a platinum sponsor of OpenStack foundation, and is now its second most prolific contributor, with hundreds of full-time employees working on this.
Tom Clark, IBM Distinguished Engineer, Chief Architect, Storage Software, Cloud & Smarter Infrastructure.
Storage Management is a critical piece of Software Defined Storage. This is done in three ways:
The use of analytics to optimize the deployment of storage, based on workload requirements. Storage admins set policies, and then IBM Elastic Storage analytics gather metrics and then optimize data placement and movement based on these policies. IBM Elastic Storage has 70 percent lower TCO that competitive offerings.
The focus on backup services. Backups are not just for data protection, but rather can be used to duplicate or replicate data for testing, for training, and for other purposes. IBM Elastic Storage is fully supported by IBM Tivoli Storage Manager.
Being able to support Hybrid Cloud environments, where some data can be on-premise, and other data off-premise. Storage Management challenges will need to deal with this possibility. IBM Elastic Storage is well positioned for this.
Carl Kraenzel, IBM Distinguished Engineer, Director of Watson Cloud Technology and Support.
Watson is ground-breaking technology, and IBM Elastic Storage technology was at the heart of the Watson that was first introduced in 2011.
To consider IBM Elastic Storage based on lower-cost and higher-scalability is not the full picture. Rather, this is an important platform for Cognitive Computing, which we are just at the tip of the iceberg in exploring. IT systems need to be aware of the context of what we are doing.
While the Grand Challenge demonstration on Jeopardy! was exciting, it is time we stop playing games and apply IBM Elastic Storage to business, to help with health care and medical research, and other problems in society. IBM has already deployed this at Anderson Cancer Center and Memorial Sloan Kettering Cancer Center, for example.
Tom Rosamilia provided closing remarks. IBM Elastic Storage is not just for new workloads in Cloud, Analytics, Mobile and Social (CAMS) but also traditional workloads as well. IBM Elastic Storage provides "data democracy" and allows for "better rested storage administrators" that make fewer mistakes.
Tom opened the floor for questions from the audience:
Q1. Data integrity, not just security but also quality? IBM Elastic Storage has end-to-end data integrity checking built-in.
Q2. How does IT transition from full control to auto-pilot? IBM allows you to tap into existing storage. This is not rip-and-replace. With storage virtualization, IBM hides the complexity that normally requires full control over specific assets.
Q3. Storage admins would rather have a root canal without Novocaine than move their data. What is IBM doing to offer automation to help storage admins move to this new infrastructure? IBM storage virtualization breaks that hard link between applications and specific storage devices. IBM Elastic Storage eliminates application downtime previously associated with data movement.
Tom Rosamilia assured the audience that IBM is fully committed to its storage portfolio. IBM Elastic Storage is not just about the profoundness of what IBM announced today, but also where IBM is investing in the future of storage.