This blog is for the open exchange of ideas relating to IBM Systems, storage and storage networking hardware, software and services.
(Short URL for this blog: ibm.co/Pearson )
Tony Pearson is a Master Inventor, Senior IT Architect and Event Content Manager for [IBM Systems for IBM Systems Technical University] events. With over 30 years with IBM Systems, Tony is frequent traveler, speaking to clients at events throughout the world.
Lloyd Dean is an IBM Senior Certified Executive IT Architect in Infrastructure Architecture. Lloyd has held numerous senior technical roles at IBM during his 19 plus years at IBM. Lloyd most recently has been leading efforts across the Communication/CSI Market as a senior Storage Solution Architect/CTS covering the Kansas City territory. In prior years Lloyd supported the industry accounts as a Storage Solution architect and prior to that as a Storage Software Solutions specialist during his time in the ATS organization.
Lloyd currently supports North America storage sales teams in his Storage Software Solution Architecture SME role in the Washington Systems Center team. His current focus is with IBM Cloud Private and he will be delivering and supporting sessions at Think2019, and Storage Technical University on the Value of IBM storage in this high value IBM solution a part of the IBM Cloud strategy. Lloyd maintains a Subject Matter Expert status across the IBM Spectrum Storage Software solutions. You can follow Lloyd on Twitter @ldean0558 and LinkedIn Lloyd Dean.
Tony Pearson's books are available on Lulu.com! Order your copies today!
Safe Harbor Statement: The information on IBM products is intended to outline IBM's general product direction and it should not be relied on in making a purchasing decision. The information on the new products is for informational purposes only and may not be incorporated into any contract. The information on IBM products is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. The development, release, and timing of any features or functionality described for IBM products remains at IBM's sole discretion.
Tony Pearson is a an active participant in local, regional, and industry-specific interests, and does not receive any special payments to mention them on this blog.
Tony Pearson receives part of the revenue proceeds from sales of books he has authored listed in the side panel.
Tony Pearson is not a medical doctor, and this blog does not reference any IBM product or service that is intended for use in the diagnosis, treatment, cure, prevention or monitoring of a disease or medical condition, unless otherwise specified on individual posts.
The developerWorks Connections Platform is now in read-only mode and content is only available for viewing. No new wiki pages, posts, or messages may be added. Please see our FAQ for more information. The developerWorks Connections platform will officially shut down on March 31, 2020 and content will no longer be available. More details available on our FAQ. (Read in Japanese.)
Jamie Thomas, IBM General Manager of Storage and Software Defined Environments
Jamie announced [IBM Elastic Storage], a new offering that is available as a software defined storage solution, based on IBM's General Parallel File System (GPFS) technology already deployed at 45,000 installations.
IBM Elastic Storage provides a global name view across data center locations. It can manage up to a Yotabyte of information, combining Flash, disk and tape resources. It supports OpenStack interfaces, Hadoop and standard POSIX file system conventions.
IBM Elastic Storage provides automated tiering to move data from different storage media types. Infrequently accessed files can be migrated to tape and automatically recalled back to disk when required. Unlike traditional storage, it allows you to smoothly grow or shrink your storage infrastructure without application disruption or outages.
IBM Elastic Storage software can run on a cluster of x86 and/or POWER-based servers, and can be used with internal disk, commodity storage, or advanced storage systems from IBM or other vendors.
IBM partnered with various clients in different industries in a special beta program. Jamie led a client panel to discuss their experiences with IBM Elastic Storage:
Alan Malek, Director of IT, Cypress Semiconductor.
"Total cycle time is key". Over the past 31 years, they bought whatever file storage was available. Now, with IBM Elastic Storage, the performance was very consistent for their engineering workloads with full load balancing.
Russell Schneider, Principal Storage Consultant, Jeskell.
Russell's company works with a lot of federal agencies, "Big Data has become Bigger Data". For example, research on Global Warming and Climate Change requires a large amount of storage across agencies.
In another example, when the tsunami hit Japan a few years ago, an agency here in the USA realized they had 14PB of data stored as a single copy in a data center at sea level less than a mile from the coast. They realized they needed to have a secondary copy, and an option to cache to a third location depending on regional disasters.
Matthew Richards, Products, OwnCloud.
For those not familiar with OwnCloud, it provides a Dropbox-like file sharing service, but in the Enterprise, with on-premise storage. It has been fully tested and certified with IBM Elastic Storage to provide a secure file sharing platform.
With IBM Elastic Storage, they were able to scale linearly up to 20,000 users, and are now testing 100,000 users. The need to have intelligent access to files at scale is what Matthew likes about IBM Elastic Storage.
Dr. Michael Factor, IBM Distinguished Engineer at IBM Research
Michael started out explaining there are three areas for storage: block, file and object. The fastest growing type of data is unstructured fixed content with associated metadata. This is ideal for object storage. Michael has been working with OpenStack Swift, an open source interface defined for object storage. He defined "storlets" as follows:
Storlets extend an object store by moving computation to the data -- filtering, transforming, analyzing -- instead of bringing data to the computation.
Storlets have been deployed on a variety of European Union research projects. For example, in partnership with Phillips, a pathology storlet can count the number of cancer cells in an image. By bringing the computation to the data, it eliminates having to transfer large amounts of data over the network.
Storlets can run on-premise and on IBM's SoftLayer IaaS cloud offering.
Bruce Hillsberg, IBM Director of Storage Systems at IBM Research
Bruce led another panel discussion, this time of IBM storage experts:
Vincent Hsu, IBM Fellow and CTO of Storage.
The problem is the isolation of data into "storage silos". Isolation causes problems in managing large amounts of data at scale, and costs more as storage is not fully utilized. IBM Elastic Storage brings everything together, eliminating storage silos.
Michael explained how IBM works with clients all over the world to ensure that storage solutions meet client requirements. For example, storlets can be used to use rich metadata to manage photographs, and display them based on GPS satellite location, or other content that makes it easier to manage these images.
IBM Elastic Storage will support OpenStack Cinder and Swift interfaces. IBM is a platinum sponsor of OpenStack foundation, and is now its second most prolific contributor, with hundreds of full-time employees working on this.
Tom Clark, IBM Distinguished Engineer, Chief Architect, Storage Software, Cloud & Smarter Infrastructure.
Storage Management is a critical piece of Software Defined Storage. This is done in three ways:
The use of analytics to optimize the deployment of storage, based on workload requirements. Storage admins set policies, and then IBM Elastic Storage analytics gather metrics and then optimize data placement and movement based on these policies. IBM Elastic Storage has 70 percent lower TCO that competitive offerings.
The focus on backup services. Backups are not just for data protection, but rather can be used to duplicate or replicate data for testing, for training, and for other purposes. IBM Elastic Storage is fully supported by IBM Tivoli Storage Manager.
Being able to support Hybrid Cloud environments, where some data can be on-premise, and other data off-premise. Storage Management challenges will need to deal with this possibility. IBM Elastic Storage is well positioned for this.
Carl Kraenzel, IBM Distinguished Engineer, Director of Watson Cloud Technology and Support.
Watson is ground-breaking technology, and IBM Elastic Storage technology was at the heart of the Watson that was first introduced in 2011.
To consider IBM Elastic Storage based on lower-cost and higher-scalability is not the full picture. Rather, this is an important platform for Cognitive Computing, which we are just at the tip of the iceberg in exploring. IT systems need to be aware of the context of what we are doing.
While the Grand Challenge demonstration on Jeopardy! was exciting, it is time we stop playing games and apply IBM Elastic Storage to business, to help with health care and medical research, and other problems in society. IBM has already deployed this at Anderson Cancer Center and Memorial Sloan Kettering Cancer Center, for example.
Tom Rosamilia provided closing remarks. IBM Elastic Storage is not just for new workloads in Cloud, Analytics, Mobile and Social (CAMS) but also traditional workloads as well. IBM Elastic Storage provides "data democracy" and allows for "better rested storage administrators" that make fewer mistakes.
Tom opened the floor for questions from the audience:
Q1. Data integrity, not just security but also quality? IBM Elastic Storage has end-to-end data integrity checking built-in.
Q2. How does IT transition from full control to auto-pilot? IBM allows you to tap into existing storage. This is not rip-and-replace. With storage virtualization, IBM hides the complexity that normally requires full control over specific assets.
Q3. Storage admins would rather have a root canal without Novocaine than move their data. What is IBM doing to offer automation to help storage admins move to this new infrastructure? IBM storage virtualization breaks that hard link between applications and specific storage devices. IBM Elastic Storage eliminates application downtime previously associated with data movement.
Tom Rosamilia assured the audience that IBM is fully committed to its storage portfolio. IBM Elastic Storage is not just about the profoundness of what IBM announced today, but also where IBM is investing in the future of storage.
International Technology Group [ITG] has just published a series of papers about IBM SmartCloud Virtual Storage Center (VSC) and SAN Volume Controller/Storwize storage hypervisor virtualization technology detailing the cost benefit advantages over EMC and VMware.
IBM delivers up to 72% lower storage TCO than EMC storage virtualization and management solutions in large enterprises ... and up to 35% lower storage TCO than VMware tools in mid-sized environments
Also, you can watch an interview with the study's author, International Technology Group Managing Director, Brian Jeffery, live from next week's IBM Edge Conference in Las Vegas. Brian will be interviewed on [TheCUBE by Wikibon] on Monday afternoon. Watch it live on May 19!
I will be at Edge next week. If you plan to be there, I would be glad to discuss these ITG findings with you and your clients in person.
When IBM designed the DS8870, it changed the bulk power supplies and batteries used in the previous DS8800 model to highly energy-efficient [DC-UPS]. In addition to reducing the overall energy consumption of the DS8870, it also gave the engineers space above the units to put 4U of standard 19-inch rack equipment.
The High Performance Flash Enclosure provides an ultra-dense and ultra-high-performance option. Each HPFE can delivers up to 250,000 IOPS and up to 3.4 GB/s bandwidth.
Up to thirty 387 GB Enterprise Multi-Level Cell (eMLC) flash cards provide up to 11.6 TB of raw capacity, about 9.2 TB usable, in only 1U of 19-inch rack space. A pair of very powerful integrated SAS RAID engines manage RAID-5 across the flash cards. The HPFE attaches directly to GX++ slots in the two DS8870 POWER7+ controllers, rather than using the Device Adapter (DA) loops.
You can have up to four of these HPFE in the "A" frame of your DS8870. Each HPFE can have either 16 or 30 flash cards. For 16 cards, you would have two spare plus two 6+P RAID-5 ranks. For 30 cards, you would add another two 6+P RAID-5 ranks.
Easy Tier Enhancements
Easy Tier is IBM's market-leading sub-volume automated tiering inside the DS8870 disk system. There were several enhancements in this announcement.
The first enhancement is to "Easy Tier Server", a feature that coordinates caching of active blocks of data inside the server's own internal Flash. This had supported Power Systems with EXP30 Ultra drawers, and now expanded to support IBM [Flash Adapter 90].
The second enhancement is to the three-level (Flash,Enterprise,Nearline) tiering algorithm. Inside the DS8870, the new HPFE flash cards will be part of the "Flash Tier" along with solid state drives (SSD) attached to the DA loops. Internal inter-tier load-balancing will take into account the faster nature of the flash cards in the HPFE, and move the busiest blocks accordingly. We we refer to this as "micro-tiering" within the Flash Tier.
Broader Solid State Drive options
Not everybody likes the 400GB solid state drives IBM offered for the DA loops, so IBM is now offering a smaller 200GB and a larger 800GB options as well.
Enhanced Concurrent Code Load
The new DS8870 R7.3 firmware release drastically cuts the activation time of concurrent code load in half.
Nobody likes warmstarts either. These are a necessary evil for some error conditions, but the clever engineers upstairs have figured out ways to reduce the number of warmstarts and eliminate the need to perform a warmstart after certain events to prevent any application impact to the attached host.
Multi-Target Remote Mirror
By now you know that IBM has the market-leading remote mirroring services for high-end disk systems, using less bandwidth and maintaining better concurrency than high-end systems from other vendors.
The DS8870 R7.2.7 firmware release can now support multi-target remote mirror. In previous releases, if you wanted three-site disaster recovery, you relied on Metro/Global Mirror, where site "A" had a Metro Mirror to a bunker site "B", and then site "B" had a Global Mirror to site "C". Not everybody liked this.
Some clients have asked for a "star" configuration, where "A"-to-"B" and "A"-to-"C" are independent of each other. A SCORE request is available for the following configurations:
Two Metro Mirror
One Metro Mirror and one Global Copy
Two Global Copy
While Metro Mirror can support up to 300km distance, and Global Copy can go any distance around the planet, there is no reason why you can't have one or both copies in the same building, or on campus nearby, for use with HyperSwap.
OpenStack Cinder interface support
Last but not least, the DS8870 now offers full support for OpenStack Havana and Icehouse releases. Support is provided through the OpenStack Cinder driver currently available for download. IBM is a platinum sponsor of the OpenStack foundation.
Continuing my coverage of the [IBM Edge2014 conference], IBM's premiere conference for System Storage and related products, here are my notes from the morning of Day 1.
IBM Storage Trends and Directions
Clod Barrera, IBM Chief Technical Strategist for IBM System Storage, and Axel Koester, IBM Chief Technologist and Executive IT Specialist for IBM System Storage, co-presented the first session of the conference.
Nearly all storage users are struggling with the combined effects of significant capacity growth, data as both an asset and potential liability, and the lack of staff and expertise to exploit new technology.
In addition to [Systems of Record], representing the traditional workloads of databases and on-line transaction processing (OLTP), we are now seeing [Systems of Engagement], which represent new workloads such a mobile apps, social business, and big data analytics.
We are now at a tipping for Flash. IBM FlashSystem can perform I/O in about 100 microseconds, which is roughly 10x faster than solid state drives (SSD), and 50x faster than spinning disk. For those clients who value performance, this can easily justify its use.
Take for example an IBM Power system running DB2 PureScale application with 43,000 transactions per second, including 13,000 updates per second, that result in 1.3 million IOPS to the back-end storage. This can be accomplished with either (a) all-disk 5,000 spinning disk spindles, (b) hybrid 2,500 spinning disk spindles combined with 128 solid state drives (SSD), or (c) IBM FlashSystem.
The comparisons are astounding. The IBM FlashSystem solution is 11x less expensive then the hybrid system, and 14x less expensive than the all-disk solution. The solution also uses 26x less energy, and 80x less space in the data center.
Clod also feels that Software Defined Storage has come of age. IBM has three offerings in this area. The first, code-named Elastic Storage, represents IBM's General Parallel File System (GPFS) and GPFS-based products like SONAS and Storwize V7000 Unified. The second is the IBM SmartCloud Virtual Storage Center and Storwize family of storage hypervisors. The third is IBM XIV Storage System.
Software Defined Storage can be used in private, hybrid and public clouds. In 2013, only 22 percent of storage was Cloud, but this is expected to grow to 50 percent by 2017.
IBM will support a range of Software Defined Environments, from the highly proprietary VMware, to the open source OpenStack foundation. Where applicable, IBM will provided added value above and beyond the basic OpenStack infrastructure.
Axel Koester presented storage futures. He works closely with IBM Research and described some of the projects they are working on:
120PB file system solution that involved a grid of IBM POWER 775 servers. Instead of traditional RAID, the system used GPFS Native Raid, which offers an 8+3 Reed Solomon protection scheme.
Multi-cloud storage that allows you to access storage from multiple public providers without having the bottleneck of a single master scheduler.
Phase Change RAM (PCRAM) which does not rely on capturing an electrical charge. This will be 12x faster than PCIe Flash, and 275x faster than consumer SSD.
Liquid state storage. Rather than solid state, metal is kept in its liquid state to store binary information.
Finally, he mentioned IBM Research's success at storing a single bit of information in just 12 atoms. To do this, the folks at Almaden Research Center had to manually move the atoms into place using the needle of a scanning tunneling microscope [STM] to nudge each atom into position.
Axel gave a great example of scale. An atom compared to a tennis ball is like a tennis ball compared to the entire planet Earth. If an atom was the size of a tennis ball, the point of the STM needle would be the size of Mount Everest, but upside down.
IBM's Smarter Storage Strategy
In previous years, my session on Storage Strategy was scheduled on Wednesday or Thursday, and attendees would comment "Why wasn't this sooner in the week? Everything makes more sense now!"
This time, I was featured immediately after Clod and Axel's keynote session, resulting in hundreds of attendees in a large standing-room-only ballroom. The session was repeated Thursday morning for those who were turned away.
IBM's storage strategy has three main themes.
First, IBM is focused on data-intensive solutions such as big data analytics. This means storage needs to be efficient to manage the growth in a cost-effective manner. IBM offers real-time compression and data deduplication to be capacity-efficient, Flash, Nearline drives and tape to be energy-efficient, and extremely easy-to-use graphical user interfaces and automation to be labor-efficient.
Second, IBM wants to optimize business critical workloads. IBM wants to eliminate the manual effort needed to balance between performance versus cost. IBM Easy Tier, I/O priority manager, and FlashSystem solutions are just a few examples.
And third, IBM wants to help you start quickly, and add value, by deploying private, public and dynamic hybrid cloud environments. IBM is not limiting its solutions to just VMware, but rather supporting other server hypervisors including KVM, Hyper-V, PowerVM and z/VM. IBM is a platinum sponsor for OpenStack foundation, and IBM storage systems support Cinder interfaces.
For those on Twitter, my handle is @az990tony and the hashtag for this event is #IBMEdge.
Continuing my coverage of the [IBM Edge2014 conference], IBM's premiere conference for System Storage and related products, here are my notes from the afternoon of Day 1 at the general keynote sessions.
Stephen Leonard, IBM General Manager, STG Sales, served as emcee for the general session.
Tom Rosamilia, IBM Senior Vice President, STG and ISC
Tom (my fifth-line manager, BTW) started off with a joke: "All this talk about Cloud, but it has to run on hardware somewhere!"
Tom insists it is imperative for clients to build an infrastructure that enables business growth. However, less than 10 percent of clients are ready for Cloud, Analytics, Mobile or Social (CAMS) initiatives. Clients need to embrace these new workloads, ensure right-time decision making, and integrate front-office with back-office IT systems.
Tom is also proud that IBM's Software Define Storage solutions manage over 1 [Yottabyte] of information today. That's a billion Petabytes, in case you were wondering. If all of this data was stored on 1TB disk drives, instead of a mix of disk and tape, it would take over one million city blocks to house all the data centers required.
Tom indicated that data is to the 21st century what steam was for the 18th century, electricity was for the 19th century, and hydrocarbons were for the 20th century.
Tom invited Mike Reagan, CIO of Cleveland Clinic in Abu Dhabi, to say a few words on why Infrastructure matters to his IT environment. The [Cleveland Clinic in Abu Dhabi] is a 364-bed multi-specialty facility, the first US-hospital replicated outside of North America.
Mike explained their great success partnering with IBM to develop a private cloud solution. Each patient has a bedside tablet that can be used to control the entertainment, lighting, temperature and window shades. It can also be used to Skype with family and friends. The facility is four times the floorspace of the Sands Expo that this event is being helenovo 61 CES awardsld in.
Jamie Thomas, IBM General Manager, Storage and Software Defined Systems
Jamie feels that data is all about security and economics. Storage admins must become the new [data scientists] for IT.
It is important to integrate traditional "Systems of Record" with new "Systems of Engagement" workloads. Her focus areas are Software Defined Storage, Flash technologies, and storage virtualization. Specific examples included:
Mike talked about how important Electronic Health Record [EHR] systems and advanced clinical diagnostics are to help make the right medical decisions.
Greg explained that Citi was operating at global scale in 100 countries. Citi partnered with IBM to deploy commodity compute servers, 10GbE/40GbE Ethernet networking and IBM Software Defined Storage to achieve Cloud economics and Cloud scale. Citi can't afford for server, storage and network admins to work separately.
Rather than contesting [Hewlett-Packard CEO Meg Whitman's FUD about this deal], Adalio took the high road, and focused on IBM's success in the x86 server space. New offerings include the X6 architecture, including PureSystems and the NextScale dense computing platform.
Adalio invited Christian Teismann, Lenovo, on stage. Christian re-iterated that IBM and Lenovo are both committed to a smooth transition, continuing IBM's roadmap for the x86 server platform, and full consideration for the x86 servers and related storage, software, service and maintenance.
IBM has had a strong relationship with Lenovo already with the acquisition of IBM's PC division, and now this deal brings together Chinese supply chain efficiency with Western ideals and design principles. Lenovo has about 46,000 employees, nearly 4,000 R&D engineers, and will acquire an additional 7,500 IBMers when the deal completes.
Adalio then invited two clients to join him on stage: Ron Grabyan, Manager of Data Warehousing Services at [Southern California Edison], and Rohit Lal, IT Direction of Coca-Cola.
Ron indicated that actionable insights must be fast for productivity. He mentioned the funny [MetLife television commercial featuring Charlie Brown and Lucy] declaring that term-life insurance should cost only "five cents" per month. In the same manner, end users often request that response times should be short. IBM was able to get response times from 40 seconds down to "5 seconds" by helping Ron deploy SAP HANA. Another process that took 53 minutes was down to 1 minute 20 seconds.
Rohit talked about their exciting new "Coke One North America" (CONA) project. This will provide consolidated IT services for 6 different Coca-Cola bottlers in North America. With $46 Billion USD in revenue serving 1.8 billion servings of beverage per day, the use of Analytics, SAP HANA and private cloud were critical to their business.
The industry recognizes Lenovo as a major x86 player, having had 20 quarters of growth outpacing the market. Lenovo has [won 61 CES 2014 awards], more than the other top five x86 vendors combined. IBM x86 servers are ideal for Enterprise solutions, Cloud, HPC, embedded designs, and IT infrastructure deployments. IBM is #1 in x86 server customer satisfaction, #1 in x86 server up-time, and boasts the #1 fastest x86-based supercomputer. IBM and Lenovo want to take this to the next level: #1 leadership in every x86 category.
For those on Twitter, my handle is @az990tony and the hashtag for this event is #IBMEdge.
Continuing my coverage of the [IBM Edge2014 conference], IBM's premiere conference for System Storage and related products, I attended EdgeTalks: Innovation That Impacts Our World that offered a series of inspiring talks styled after the famous [TED] conferences.
Surjit Chana, IBM Chief Marketing Officer (CMO) and VP of Strategy for IBM Systems and Technology Group, served as emcee to introduce the speakers.
Ron Finley, Renegade Gardener
Back in 2003, "South Central" was [renamed to South Los Angeles]. But as everyone in IT knows, merely renaming something doesn't fix any of its problems. Ron was tired of seeing empty lots filled with old mattresses, used condoms and discarded tires, and wanted to beautify his immediate surroundings by planting vegetables in his front yard.
Ron's army of volunteers, the [L.A. Green Grounds], filed a petition. As of October 2013, it is now legal to grow food on your parkway in Los Angeles.
Ron explained that South Los Angeles is a [food desert], where it is nearly impossible to get healthy, organic food. He is concerned the "drive-thrus" of fast food restaurants kill more of his neighbors than [drive-by] shootings.
Ron has discovered this problem is not limited to Los Angeles. The American food system is designed to fill you with processed food and chemicals, made worse by a health care system happy to cut you open or prescribe you more chemicals and drugs. Everywhere processed food goes, chronic disease follows. The USA exports obesity to the rest of the world.
"To change a community, and you must first change the composition of the soil." -- Ron Finley
The rise in cancer, diabetes, and childhood cardiac arrests inspired Ron to start the [Ron Finley Project] consisting of community farms, a marketplace that accepts EBT, SNAP and other government food programs, and portable "container cafes" based on standard shipping containers that could be placed near a garden to help sell the food grown locally.
John Wilbanks, Chief Commons Officer at Sage Bionetworks and Senior Fellow in Entrepreneurship for Faster Cures
We live in the age of cheap data. John prefers the term "cheap data" rather than "big data". Mapping the first human genome cost $3 Billion USD, now John can get his own genome mapped for about $1200.
John feels this cheap data changes the way we justify our opinions. From baseball scouts to the analytics demonstrated in the movie [Moneyball]. President Barack Obama used social media to help win elections. And cheap data is coming to health and medicine.
John gave an interesting example. A grad student wanted to study alcoholism among undergraduate students. The traditional method would have been to gather privacy permission slips from volunteers. Instead, he "friended" 4,000 undergraduates, and looked on social media containing the [distinctive color of red beer cups] for photos taken on Monday through Wednesday, indicative of a drinking problem. This innovative approach allowed the grad student to complete his research in less than six weeks.
Cheap data doesn't mean we have wisdom. John explained the wrong way of doing things. There are several machine-learning apps for smartphones to check for melanoma. Take a photo of your suspected mole, and the app will determine if it detects skin cancer, and recommend a biopsy. Incentives to sell apps, and to perform biopsies, result in 90 percent false positive rates. There is no financial incentive to improve accuracy.
Sharing is the innovation that converts cheap data into wisdom. Get the world's smartest people to compete to create wisdom. Collaborating with IBM on Dialogue for Reverse Engineering Assessments and Methods [DREAM] platform, a competition for modeling breast cancer was launched. Requiring all participants to share their code in real-time allowed the accuracy of the model to jump three orders of magnitude in just nine days. Over 60 teams participated. The winning team was awarded an article and cover of [Science Translational Medicine] magazine.
John feels that there are very few genius [data scientists] in the world, and they are isolated, hideously overpaid, managing hedge funds or search engines, but would probably rather be looking for cures for cancer.
Progress is not made if every company only has its own people looking at its own data. John wants data to shared amongst the world's scientists to create wisdom. However collaboration flies in the face of the competition that all the reward systems are based on in health care.
As an experiment, John wanted to make his own genome public. However, that requires "informed consent" for others to use his private health information, and it took him six months of legal and ethical rules to develop a system for him to provide this consent for public use.
In much the same way that gardens and fields were the first [commons] shared by farmers, John feels we need to cultivate the public domain, the "digital commons". This can truly transform medicine and health care.
Peter Singer, Technology Expert and Best-selling Author
The first web page appeared in 1991, and now there are over 30 trillion pages. Over 98 percent of military communications occur over civilian internet communications. The [Internet of Things] adds everything from smart cars to medical devices into the equation.
But along with all the benefits the web has brought society, there are also risks. Every second, nine new pieces of malware are discovered. An astounding 97 percent of Fortune 500 have admitted to being hacked. Over 100 governments have established a cybermilitary force.
(Instead of Powerpoint slides, Peter had a slideshow of his personal collection of the world's best and worst cybersecurity art. Studies show that audiences remember 60 percent more if they are looking at pictures when they hear a speaker.)
While IT folks are good at dealing with both hardware and software, they traditionally don't do well with "wetware", the human side of things. Essential cybersecurity terms and concepts are often misunderstood.
Business leaders over-react to some threats, but completely ignore others. Consider that 70 percent of cybersecurity decisions at companies are made by executives who have no training in cybersecurity. No single MBA program offers cybersecurity courses.
There is a shortage of talent to deal with cybersecurity. Hiring managers are only satisfied with 40 percent of the employees they hire in this Cybersecurity space.
Incentives help explain why some industries like financial services do security well, while others like health care do poorly.
In an effort to find which employees do not take cybersecurity seriously enough, Companies have resorted to sending [phishing] emails to their own employees. Those that click are caught, and must attend mandatory training, or are subject to dismissal. Unfortunately, senior executives are twice as likely to click on phishing emails than the general workforce.
Peter recommends companies focus on resilience. You can never build high enough walls to eliminate threats. Instead, focus on bouncing back after attacks, similar to the anti-bodies in the human body deal with illness.
Ben Franklin said that an ounce of prevention is worth a pound of cure. Peter cited a studied that found proper cyberhygiene would have prevented 94 percent of attacks. The most successful foreign military attack on the U.S. military happened when a soldier saw a memory stick in a parking lot, and was curious enough to connect it to the secure military network to see what it contained.
We need to build an ethic. We teach our kids to cover your mouth when you cough. This does not protect your child in any way, but is an ethic to avoid spreading disease. We need to teach the same ethics related to cybersecurity.
All three were excellent talks focused on innovation. Ron Finley used gardening in otherwise empty urban spaces to help grow people as well as food. John Wilbanks used innovation to help bring the smartest minds to determine models for identifying cancer from genomes. Peter Singer marveled at the innovation of the Internet, and how proper cyberhygiene is needed to keep it secure.
These talks were recorded and available on this [98-minute YouTube video]. For those on Twitter, my handle is @az990tony and the hashtag for this session was #ibmedgetalks.
Continuing my coverage of the [IBM Edge2014 conference], IBM's premiere conference for System Storage and related products, I attended keynote sessions on Tuesday morning, titled "Delivering on the Promise of the Future: Made with IBM".
Once again, Stephen Leonard, IBM General Manager, STG Sales, served as emcee for this general session. Yesterday, the executives focused on the "What" and "Why" for new IT initiatives. Today, they want to tackle "How" to accomplish all this.
Robert LaBlanc, IBM Senior Vice President, Software and Cloud Solutions
Robert estimates that 70 percent of enterprises will pursue dynamic hybrid clouds by 2015. Big data and analytics represents a $17 trillion USD opportunity, about 25 percent of the total IT industry.
IBM helps companies extend what they already have to what they need. In the future, people will ask "Who remembers building a private cloud stick-by-stick?" Today, IBM supports the deployment of patterns of expertise that can work on-premise IBM PureSystems. These can easily be moved or deployed off-premise to IBM SoftLayer private and public cloud offerings.
Snehal Antani, CIO of GE Capital
IT has shifted from the "back office" to the very core of business. Technology now allows GE Capital to go quickly from whiteboard to roll-out.
Not everyone is on-board. At GE Capital, people are encouraged to be like [Tigger", the adorable character from Winnie the Pooh stories, to lead efforts of innovation and collaboration. Cynics are tagged as [Eeyores], always finding a reason or excuse why plans won't work. Finally, we have "Kings and Queens", eager to be offended that any changes are needed at all.
Snehal also mentioned their "No squirrel" policy. If you have seen the movie "Up!", you know that the dog was constantly distracted by squirrels, or things he thought were squirrels. Many IT people fall the latest "shiny object" in technology.
Arvind Krishna, IBM General Manager of Development and Manufacturing
Arvind feels that "data" is the new base of new business value, in the same manner as steam, electricity and hydrocarbons had done in past centuries. In the past, most data was stored in databases, but today over 90 percent is unstructured.
In 2008, there were more "things" than people attached to the Internet, and this [Internet of Things] is expected to exceed 1 trillion items by 2015.
Have you ever wondered how the NFL plans each year's football game schedule, balancing 32 teams across five television networks? There are over 800 quadrillion possible combinations!
Borrowing the analogy from Snehal from GE Capital, the football teams are the Eeyores, and the networks are the Kings and Queens. This year, three of the games will be played in London, England. With IBM's help, the NFL was able to finish the 2014 schedule earlier than before.
Maria Winans, IBM Vice President, Social Business
Maria started with an interesting anecdote:
Lily Robinson, age 3, sent a letter asking a local grocery chain Sainsbury why their "tiger bread" was not called "giraffe bread" as it looked more like the spots on a giraffe. A manager provided a nice reply. Her parents posted it on social media, the conversation went viral, and [Sainsbury changed the name of their product] to "giraffe bread".
This is an example of "People-centric" engagement, rather than dealing with consumers in marketing segments or categories of gender or race. People will share personal data with companies they trust. Smarter companies use this data to provide the right experience at exactly the right time.
Maria explained IBM AlwaysOn Engagement Center which allows companies to track social mentions. For example, there were over 52 million social mentions of IBM Edge 2014 so far during its first two days!
The process is not just for clients, customers and consumers. It can be used to engage individual employees to drive business outcomes, or individual citizens to deliver sustainable economic growth and improve living standards.
This was a nice balance, combining IBM executives with client testimonials.
For those on Twitter, my handle is @az990tony and the hashtag for this event was #ibmedge.
Over time, I have gotten many emails, comments and tweets related to this post. The instructions have been downloaded over 130,000 times!
The letter below was so inspiring that I felt I need to share it. (Published here with permission from the author, who goes by the screen name DaveAlex)
Thought you would like to know that I am working toward an AI Agent hopefully more advanced than "Watson Jr." although I will probably include the software behind it.
The hardware I have on hand is a System X3650M2 which I bought for $250 on eBay. It has four 2.66 GHz Xeons with 6 cores each, and 16 GB RAM. I have another 16 to install when I need it. I will shortly have 4 TB of HDD space on line, plus an addition 3 TB USB3 drive.
Ultimately, I hope to have some of the available knowledge bases on line, Freebase, CYC, etc which will handle specific information perhaps better than the Watson software by itself.
What the target (goal) that I am aiming for is a stationary version of Commander Data of Star Trek, Next generation.
I envision if having some form of self knowledge, being capable of processing graphical data, i.e., facial recognition, gesture interpretation, voice input/output, mathematical processing, with graphical output (display & hardcopy) and several additional features.
As I have studied this project, I am amazed at how much of the required software is already available. The biggest stumbling block is integrating the separate parts.
Back to Hardware. I just bought 2 Dell 2850 servers, each with dual Intel Xeons which can handle some of the tasks. If I need more processing power, I just happen to have about 10 other towers with Pentium IV or dual core processors sitting around, which can be pressed into service as needed. So far, my total cost is less than $1000 US Dollars, and my wife has not thrown me out yet. I continue to watch eBay for additional older used equipment for fractions of the original cost. My friends who follow my project keep telling me that I need to get on with the software, and add hardware as needed; they are absolutely correct, but I can't resist a bargain.
The power consumption is a potential problem, but I have a 4500 Watt solar array to use. The cooling could be a problem too, but my house sits into the side of hill, and can readily duct the air supply pass the sub-surface wall, perhaps with old Processor cooling fins glued to the wall.
I hope to get some hobby programmers involved in the project, it is a bit beyond my programming capabilities. I hope that I can live long enough to see it come to fruition; I am 78 now, and mentally in very good condition.
Wow! He is 78 years old! While others his age are playing shuffleboard at the nursing home, he is out there learning new things about the latest technology. I wish him the best of luck on this! If you would like to reach out to DaveAlex, send me a note or comment below, and I will forward them on to him.
Well, it's Tuesday again, and you know what that means? IBM Announcements!
Back in 2007, my blog post [Double Happy Wedding] compared IBM's acquisition for a company that produced data migration software to the practice in Japan of waiting until the bride is five to seven months pregnant to have a wedding. In USA, these are called "shotgun" weddings.
I was in Japan when I wrote that, and the company IBM acquired was Japanese, so the comparison stuck.
Today, IBM announces the latest versions Transparent Data Migration Facility z/OS v5 [TDMF] and z/OS Dataset Migration Facility v3 [zDMF] software products.
(Where better to commemorate this event than in Pigeon Forge, Tenessee, the capital of shotgun wedding venues! Including, and I am not making this up, a replica of the [grand staircase of the Titanic]. Yes, you can book this for a shotgun wedding, while your guests re-arrange the deck chairs. I stopped at a local McDonald's to submit this blog post.)
TDMF software allows you to migrate CKD volumes that are attached to your System z mainframe, including those that are actively being used by applications. zDMF allows you to migrate z/OS data sets, including those currently open by applications.
The migration is hardware-agnostic, supporting CKD volumes on IBM, EMC and HDS disk systems. As many clients are migrating from EMC and HDS disk systems to IBM DS8870, this is a good time to look at TDMF and zDMF to help make the process as transparent as possible.
Of course, if you are not interested in acquiring the software to do this yourself, you can hire IBM Data Mobility Services, which uses TDMF and zDMF to do it for you!
Hello everyone! I am back, fully well-rested from a wonderful 3-week vacation touring the lovely state of Tennessee. Here's a quick recap:
(FCC Disclosure: I mention various companies and products in this blog post. I have no financial interested in any of them, nor have I received any compensation to mention or endorse them here.)
Our first stop was Lynchburg, TN, home of [Jack Daniel's], America's oldest whiskey distillery. Our tour guide, Ron (who both looked and sounded like [John Goodman]) took us first to see how they burn wood to make charcoal, then the natural water spring which supplies the iron-free water used for the whiskey. We then got a whiff of the mash at various stages of fermentation. Lastly, we had samples of Original No. 7, Gentleman's Jack, and Single Barrel.
(A word of caution: Domestic airlines only allow FIVE LITERS of Bourbon, Whiskey or Rum in your checked luggage. That is only six bottles at the 750ml size, of beverages that are between 24 to 70 percent alcohol by volume [ABV]. Anything above 70 percent is considered too flammable to take on the plane. Excess bottles can be custom packed and shipped, but can be quite expensive. Nearly everyone we met drove all the way to Tennessee instead of flying, and now I understand why.)
While in the area, we had a nice lunch at [Miss Mary Bobo's], a boarding house turned into a restaurant. They only serve one meal a day at 1pm, by reservation only. And we were paired up with eight others and served food "family style" a large round table with a [Lazy Susan].
Jack Daniel's is not the only attraction in the area. We also visited [Falls Mill], a grist mill that grinds corn, wheat and rye for the other distilleries. Mo and I visited [Prichard's Distillery], where they make Whiskey, Rye and Rum. We highly recommend their molasses-flavored "Sweet Lucy"!
We stopped at the famous historic landmark, the [Chattanooga Choo Choo], which was formerly a train station, and now renovated into a hotel. We asked to see the inside of one of the train cars converted into a hotel room.
Gatlinburg and Pigeon Forge
We stayed in a cabin in the [Smokey Mountains] near Gatlinburg. In addition to pleasant rides through the National park, we also walked around the small town, looking at all the shops and amusements.
The next town over is Pigeon Forge, and driving down the main parkway is like Las Vegas in a slightly alternate universe. One person called it the Redneck Riviera!
We spent two days at Dollywood theme park, named after its founder, famous country singer Dolly Parton. We arrived after 3pm the first day, so they gave us the second day free!
In addition to roller coaster rides, artisan shops and restaurants, we found zip lines! Mo and I put on harness, attached to a pulley, and zipped over roller coasters, trees and rivers throughout Dollywood park. It was a lot of fun!
We also went to Dolly Parton's other attraction: Stampede. This was a dinner show with horses. It was similar to the Excalibur show we saw in Las Vegas last year during the week of Edge 2013 Conference.
On our way from Gatlinburg, we stopped into Knoxville to have lunch with clients. We had a choice to make, we could either drive up into Kentucky and visit the distilleries in the Bourbon trail, or drive straight to Nashville and spend more time there. We opted for Nashville, saving the Bourbon trail for a future trip.
Our final stop was Nashville, known as Music City. Our hotel was on Broadway, walking distance between Vanderbilt University and the [honky-tonks] downtown.
We had purchased advanced tickets for the [Grand Ole Opry]. This is not your typical concert. Instead, you have no idea who will play until just a few days before. The three hour show had about a dozen different musical acts, some famous, some new to the country music scene.
We went to the Johnny Cash Museum. People with ticket stubs from the Grand Ole Opry get in for a discount!
Searching [TripAdvisor] for things to do in Nashville, I found [The Escape Game]. You pay them money to lock you up in a room with a bunch of strangers, and then collectively as a team you need to figure out how to escape by solving puzzles and clues.
Each room has different themes. First, we tried the "Underground Playground". You know that TV show [Are you Smarter than a Fifth Grader?] Well, the majority of our so-called team were not in this case, and after 60 minutes the referee told us we had failed and unlocked the door.
We had so much fun that we came back two days later to try a different room. This time we tried "The Heist" which is all about art theft. The strangers we were teamed up with were very motivated to get out of the room in time, and we succeeded, getting out in just 54 minutes!
Mo and I had a great time, but are glad to be back home!
We have a lot to cover, so I will do the quick recap today, and then go in-depth on subsequent posts.
IBM FlashSystem 840 and V840
The FlashSystem now offers a high-voltage 1300W power supply. There are two supplies providing redundancy. In the unlikely event that you are doing maintenance on one of them, the other supply handles all the workload. With the original power supply, the system slowed down the clock speeds to reduce electrical demand. The new power supplies can handle full performance.
Also, the Graphical User Interface (GUI) now holds 300 days of performance data with pan-and-zoom capability. Five predefined graphs showing key performance metrics with additional user-defined metrics available for visualization.
The new v7.4 level of microcode combines features from v7.2.7 and v7.3 into a single code base.
In previous 3-site mirroring implementations, you had A-to-B-to-C cascading. Metro Mirror would get the data from A-to-B, then Global Mirror would copy B-to-C. Multiple Target Peer-to-Peer Remote Copy (PPRC) feature number 7025 allows you to have two separate paths of the data: A-to-B and separately A-to-C. Some folks refer to this as a "star" configuration.
For System z mainframe clients, the new v7.4 introduces new zHyperWrite for DB2 database logs, enhances zGM (XRC) write pacing, and extends Easy Tier automated-tiering API to allow z/OS applications to influence placement on different tiers of storage.
The High Performance Flash Enclosures (HPFE) that IBM introduced last May for the "A" frames are now available for "B" frames. You can have four HPFE in A, and another 4 in B.
DS8870 now offers 600 GB 15K rpm SAS and 1.6 TB 2.5-inch SSD encryption drives for additional capacity and cost performance options to meet data growth demands within the same space. Both support data-at-rest encryption.
Lastly, we have upgraded the OpenStack Cinder driver to the latest Juno release, including features like volume replication and volume retype.
The latest SAN switch is a slim 1U high box that can be configured with 12 or 24 ports. These are 16Bps ports that can auto-negotiate down to 8Gbps, 4Gbps and 2Gbps. These are easy to set up, and can be managed with the IBM Network Advisor management software.
GPFS is the core technology for IBM's "Codename: Elastic Storage" initiative.
You have several options. First, you can purchase just the GPFS software itself. It runs natively on AIX, Windows and Linux, and can be extended to support other operating systems through the use of NAS protocols like NFS or CIFS. Today, the Linux support which was previously just x86 and POWER has been extended to include Linux on System z mainframes as well.
GPFS v4.1 offers "Native RAID" support, with de-clustered RAID in 8+2P and 8+3P configurations. Like the IBM XIV Storage System, this scatters the data across many drives, and can tolerate drive failures better than traditional RAID-5 configurations.
Another option is to get a pre-configured "Converged" appliance that combines servers, storage and hardware. We already offer SONAS and the Storwize V7000 Unified, but IBM now offers the "GPFS Storage Server" running on the new P822L Linux-on-Power servers, RHEL v7, and and GPFS v4.1 with Native RAID to twin-tailed attached DCS3700 expansion drawers. Since GPFS provides the RAID, no need for DCS37000 controllers, saving clients substantial costs.
The IBM Storwize family includes SAN Volume Controller, Storwize V7000, Storwize V7000 Unified, Storwize V5000, Storwize V3700 and Storwize V3500.
The big announcement is that IBM now offers data-at-rest encryption for block data on internal drives in the new generation of Storwize V7000 and V7000 Unified models. There is no performance impact, and no need to purchase new SED-capable drives.
Data-at-rest encryption helps in several ways. First, it protects data if a drive is pulled out and taken away maliciously. Second, it protects data if the drive fails and you want to send it back to the manufacturer for replacement. Third, it allows you to perform a "secure erase" so that the data can be sold or re-purposed without fear of anyone reading previous data.
Initially, the encryption key management is built-in, with the keys stored on a USB memory stick physically attached to the model. In the future, IBM will extend this support to SVC, extend this support to external virtualized drives, and extend this support to IBM Security Key Lifecycle Manager (SKLM).
Other announcements include 16Gbps adapters for SVC, Storwize V7000 and V7000 Unified. The entire Storwize family will also enjoy both 1.8TB 10K RPM 2.5-inch drives, and 6TB 7200RPM 3.5-inch drives
See the Announcement Letter (available later this month) for details.
New TS1150 enterprise tape drives
The anticipation is over! The new TS1150 tape drive has been announced, with 10TB raw un-compressed "JD" media cartridge capacity and 360 MB/sec throughput performance. The new drive is read/write compatible with TS1140 on JC, JY and JK media cartridges.
For the virtual tape libraries for the System z platform, IBM offers two models. The TS7740 had a small amount of disk front ending tape library of physical tape. The TS7720 had a large amount of disk with no tape library.
But then the person carrying the chocolate bar bumped into the person carrying the jar of peanut butter, and the rest is history. IBM will now allow tape attach on TS7720, best of both worlds! Large disk cache plus tape library attach.
Tape-attached TS7720 configurations can have up to eight partitions, with different partitions have different policies. Some might move data from disk cache to tape more aggressively, while other partitions may keep data on disk for longer periods, or indefinitely if needed.
Logical tape volumes can now be up to 25GB in size.
The DCS3700 is IBM's entry-level disk system for sequential-oriented workloads. Today, IBM announced new disk drive options: 400GB 2.5-inch SSD, 800 GB 2.5-inch SSD, and 1.2TB 10K RPM 2.5-inch drive. All of these offer T10 Protection Information (PI) data integrity.
(Note: While Lenovo has officially taken over the System x on October 1st back in the United States, China, and several other countries in Asia and the Americas, it has not yet happened in Europe. This is expected to happen this December. This results in some awkwardness during this period of transition.)
Day 1 started off with some keynote sessions. Amy Purdy, IBM Director of Training Services, was the emcee.
Gareth Tucker, Director of EMEA for Intel
Gareth focused on the strong partnership between IBM, Lenovo and Intel. For example, a client query that took 4 hours with traditional DB2 database on Intel Xeon, but only 90 seconds on DB2 BLU with the new Xeon V2 chip.
10 years ago, some storage vendors warned clients not to use any Intel-based storage devices. Today, over 85 percent of storage is Intel-based, including most of the IBM System Storage portfolio. IBM SoftLayer also uses Intel to offer both bare metal and virtual x86 servers, and was the first cloud provider to use Intel's "Trusted Execution" mode.
Next year, Microsoft will drop support for Windows 2003 server on July 15, 2015. This represents an excellent selling opportunity to get clients to upgrade their x86 server hardware. Intel estimates there are 24 million instances of Windows 2003 worldwide. On average, it takes 150 days to migrate to Windows 2012, so get clients to start now!
Jeff Howard, Vice President of Lenovo Flex and BladeCenter
Jeff was a last-minute stand-in for Adalio Sanchez who is busy getting thousands of employees and hundreds of trailer trucks full of IT equipment from IBM's Raleigh location to Lenovo's new building in Morrisville.
Lenovo's goal is simple: to be the #1 vendor of x86 enterprise servers. Lenovo sees a $44 Billion USD opportunity in x86 servers, with an additional $14B opportunity selling IBM System Storage attached to these servers. Lenovo is already #1 for Personal Computers in the consumer space, and is #1 for customer satisfaction. IBM System x #1 in reliability and up-time for x86 servers. In a client survey of how many clients had an outage lasting four hours or more, less than 1 percent from IBM System x compared to 13 percent for HP servers. That's a big difference!
There is a 40 percent growth in "Converged Systems" such as the Flex System and PureFlex systems. Lenovo will take over the x86-only versions of these, while IBM will retain the POWER-based and Power-and-x86 hybrid models. IBM will also retain the PureApplication and PureData models of the PureSystems line.
Lenovo is also focused on security. Their "Trusted Platform" includes Self-encrypting Drives (SED) managed by IBM Security Key Lifecycle Manager software, and Crypto-assist co-processors.
Jeff also mentioned new reference architectures for VMware's VSAN, Microsoft's Fast-track Data warehouse for SQL Server, SmartCloud Desktop Infrastructure VDI with Atlantis ILIO, and Flex Systems for Hyper-V.
Greg Lotko, VP of IBM Storage Systems Development
Greg is the new VP of Storage Systems Development, about 11 months on the job, but I am glad to hear that he recognizes that IBM System Storage has a huge portfolio of products.
He focused on those areas where IBM is ranked #1:
IBM is #1 for All-Flash arrays.
IBM is #1 for Software Defined Storage (SDS).
IBM is #1 for Tape, including tape drives, tape libraries and virtual tape systems
The weather here in Dublin is great, although I have had not had much time to enjoy the outdoors with all the awesome and interesting sessions inside!
Well, it's the end of the year, so I thought a recap of year 2014 would be in order.
The year started out with some January announcements, including the IBM FlashSystem 840. IBM is proud to be ranked #1 in All-Flash Arrays, and the IBM acquisition of Texas Memory System has caused all of the other competitors to scramble their own wanna-be offerings. IBM also announced it was going to sell off its System x division to Lenovo.
In February, I wrapped up a project to build a Linux-based PC for a kindergarten class. IBM announced some exciting new things at Pulse 2014 conference, including IBM Bluemix Platform-as-a-Service (PaaS), new IBM SmartCloud Virtual Storage Center offerings, and acquisition of Cloudant Database. Also, on Valentine's day, IBM announced the FlashSystem V840, which combines the software-defined storage features of SAN Volume Controller, with the Microlatency of the FlashSystem 840. IBM sold its 10,000th PureSystems converged expert-integrated system.
In March, I completed a six-month film project ["A Tucson Executive Briefing Center: A Quick Visual Tour"]. I was writer/director/actor for this quick 3-minute film posted on YouTube. I wrote the script and had it reviewed by a professional script reviewer, hired a professional cinemetographer, paid royalties for background music, located a voice-over expert for narration, and trained the actors (all IBM employees) how to read their lines and stand on their mark for the camera. It was a big success!
In April, I presented at the Systems Technical University in Istanbul, Turkey. I had been to Turkey before, but this was my first time to the city of Istanbul itself. The owner of my local [Savaya Coffee] is from Istanbul, and was able to introduce me to someone who was able to arrange for a full tour my first day! Meanwhile, on the other side of the pond, IBMers in New York were celebrating the 50th anniversary of the IBM mainframe, including a cameo appearance on the TV show "Mad Men".
In May, I was busy presenting at the IBM Edge conference in Las Vegas. IBM celebrated the sixth anniversary of IBM ProtecTIER data deduplication device, announced "Codename: Elastic Storage" and new features on the DS8870 disk system, and presented analyst findings that IBM Software Defined Storage was substantially less expensive than competitive offerings.
In July, I took a nice summer vacation, [a road trip across the state of Tennessee]. IBM made a strategic partnership with Apple to offer mobile apps for the data center enterprise for the iOS operating system on iPhones and iPad tablets.
In August, I completed a summer partnership with University of Toronto and IBM Softlayer to build "Concept IBM Watson", a scaled down version of IBM Watson based on my infamous 2011 blog post [How to replicate Watson hardware and systems design for your own use in your basement]. Rather than using three physical servers, however, we had virtual x86 machines running on IBM Softlayer cloud. The system was only asked the simplest "How many...?" questions against a single text document, but proved to the University that teaching analytics by replicating IBM's historic achievement was effective and possible.
In September, I celebrated my eight year "Blogoversary". That's right, I have been blogging for the past eight years! With over 800 posts, and five published books, I countinue to be ranked #1 most-read blog on IBM developerWorks. IBM was ranked #1 for Software Defined Storage!
In October, I presented at the Systems Technical University in Dublin, Ireland. This was my first time in Ireland, and I found Dublin to be quite a beautiful city, with friendly people and delicious food.
The rest of October, and much of November and December, I spent on the road, visiting clients to help close deals! (Sorry folks... Due to SEC black-out rules, I am prohibited from telling you how well I did) Since I am not allowed to talk about on-going discussions that I have with clients, my blog has been noticeably silent during these months. I apologize for any stress or anxiety this might have caused any of my readers!
Despite too-much-candy, too-much-turkey and too-many-cookies that the year-end often brings, I managed to lose twenty pounds on a low-carb, gluten-free, Paleo diet and exercise.
Well it's Tuesday again, and you know what that means? IBM Announcements!
(Update: I thought it was quite clever to announce the new z13 mainframe on January the 13th. A few [triskaidekaphobic] employees pointed out that certain [Greek and Spanish-speaking cultures] consider Tuesday the 13th to be an unlucky day. However, superstitious people should probably not work in IT, as it would be difficult for a worldwide company like IBM to avoid all the numbers that different cultures consider unlucky.)
You are cordially invited to join IBM on January 14 from 2:00pm to 4:30pm Eastern Standard Time (US) when IBM will share a whole new generation of IBM z Systems™ built to meet the needs of your digital business. Join us and learn how IBM z Systems are designed to:
Support the transaction growth and needs of the mobile generation and the Internet of things
Integrate data, transactions and analytics, for in-transaction insights and right-time actions
Provide secure, trusted and efficient cloud services with new economic models
Exploit new modern, open development environments, tooling and skills for greater returns
At this live streaming event, you will hear from a remarkable group of business and technology leaders who will share success stories, best practices and the exciting technology innovations and capabilities of the new generation of IBM z Systems. Go to the Registration page] to participate.
But what does this really mean? Are you thinking BFD?
(Update: For those not familiar with IT acronyms, BFD refers to "Bigger, Faster, Denser" -- the trend in IT to announce new generations that are merely bigger, faster, and/or denser versions of the previous generations. Fortunately, the z13 takes up the same amount of data center floor space -- 2 floor tiles = 2 square meters = 20 square feet -- and weighs approximately the same as the z196 and zEC12, so raised floor struts do not have to be strengthened or reinforced to take in this new system.)
You may have noticed that we are now talking about "z System" instead of "System z". This change was made to line up with IBM's change to "POWER Systems" from "System p". Leadership felt that dropping the stodgy old zEnterprise and giving the mainframe a "hip" new name would attract new emerging digital workloads like Cloud, Analytics, Mobile and Social.
This is not the first time IBM has renamed products in a series. While the IBM mainframe just celebrated its 50th anniversary last year, the "13" refers to the 13th generation of CMOS-based mainframe technology introduced in 1994. Here is a quick table to show you the names that have evolved over the years:
1 to 6
S/390 G1 to G6
zSeries z800 and z900
zSeries z890 and z990
9 to 10
System z9 and z10
System z196 and z114
zEnterprise zEC12 and zBC12
(Note: This change also corresponds to a completely restructuring of IBM into business units, eliminating its former hardware and software groups. The design and development of all mainframe-related hardware, software and middleware will be consolidated under the IBM Systems business unit. I will wait for IBM's 4Q financial results announcement on or after January 20 before I cover this in any more detail.)
The z13 machine itself has some unique differences from previous generations. Instead of a "Multi-chip Module" (MCM) that contained multiple processor and storage controllers on a single slab, the z13 uses Single-Chip Modules (SCM) that are either a single 8-core processor, or a single system controller, allowing them to be field replaceable units (FRU).
Previous generations organized the processors in 1 to 4 vertical "books". The problem was that if you had a single book system, you bought a lot of hardware infrastructure designed to support a full four books. In the new design, processors are organized into horizontal Central Processor Complex (CPC) drawers, with additional hardware infrastructure provided per drawer. This makes the lower-end models more affordable. Each drawer has six processor SCMs and two system controller SCMs, providing 39 to 42 usable cores per drawer. Models ranges from 30 to 141 usable cores, with the option to upgrade from one model to another as your needs grow.
The z13 provides N-2 generation compatibility. This means you can have the z196, zEC12 and z13 all participate in the same Parallel Sysplex. You will also be able to upgrade your z196 or zEC12 to the new z13 system.
The new z13 can have up to 10TB of memory, and this can be assigned entirely to a single Logical Partition, or LPAR. The system can be subdivided up to 85 LPARs, versus 60 on the previous generation. Currently, z/OS v1 can only have up to 1TB per LPAR, and z/OS v2 can only go up to 4TB, so I suspect this 10TB is planning for future OS releases.
The new z13 now offers Simultaneous Multithreading [SMT]. Initially, this will double the number of threads for IFL engines (supporting Linux and z/VM), and zIIP engines supporting DB2, Java, XML and IPsec workloads. IBM is eliminating the zAAP engines, since zIIP engines can do all of that. The new [Preview z/OS v2.2] will take advantage of this SMT capability.
To assist with database, analytics and multimedia workloads, the z13 offers Single Instruction, Multiple Data [SIMD] capability. This allows a single instruction to perform the same update or action across many data fields.
For those clients with zBX models 2 and 3, allowing you to run POWER-based AIX and x86-based Microsoft Windows and Linux operating systems on your mainframe, they will be able to upgrade to [zBX model 4 for the z13 System]. Now that IBM has sold off its x86 server business to Lenovo, I suspect it will also phase out the zBX offerings as well.
To handle emerging workloads of Cloud, Mobile and other Web applications, IBM will offer a new stronger and faster Crypto Express5S cryptographic adapter. The z13 will enhance public key support for constrained digital environments using Elliptic Curve Cryptography (ECC) for users such as Chrome, Firefox, and Apple's iMessage. The z13 will also minimize reformatting of databases with new exploitation of VISA format preserving encryption (FPE) for credit card numbers.
The z13 also made some enhancements for Linux clients. The zAware analytics that analyzes internal traces and logs for z/OS has been extended to support Linux on System z. For those who want to use GDPS Business Continuity and Disaster Recovery services, but don't want to develop z/OS skills for the "K" system, there will now be a Virtual GDPS appliance that will run self-contained z/OS. Lastly, IBM has made a statement of direction that it will support open source Linux KVM as a Linux-only alternative to z/VM hypervisor. OpenStack will support both this new Linux KVM as well as z/VM 6.3 release.
The PCIe bus has been upgraded to Gen3 at 16Gbps, from Gen2 used in the zEC12. These can be used for Coupling Facility Links, which are faster than the legacy 6 Gbps InfiniBand, which are also supported for legacy migration. People with z196 and zEC12 can either carry forward their I/O drawers they have previously purchased, or move the PCiE Gen2 cards into the new Gen3 drawers.
The new z13 will also support 16Gb FICON, using the new FICON Express5S cards. Here is my segue into storage, as you are probably now wondering when I was going to get to the storage part of the announcement!
IBM is also announcing corresponding changes to the DS8870 firmware and accessories to go with the z13 System. This includes:
FICON Dynamic Routing
Reduce cost with improved and persistent performance for supporting I/O devices. This feature will allow SAN directors to have both FICON and FCP share the same Inter-switch Links (ISL). This is especially useful for clients who use FCP with their Linux, z/VM, AIX or Windows workloads.
16Gb Host Adapters
Improve network performance with twice faster FC and FICON adapters, and minimize latency for database log writes with zHyperWrite and Metro Mirror. These 16Gb adapters can auto-negotiate down to 4Gb and 8Gb, so that the DS8870 can connect to both the new z13 mainframe, as well as older models.
Forward Error Correction
Preserve data integrity with more redundancy on the information transmitted via 16Gb adapters.
zHPF Extended Distances improvements
Increase remote data speed with 50 percent better I/O performance when accessing remote disk, typically after a HyperSwap. The "zHPF" acronym is short for z System High Performance FICON.
Improved resiliency capabilities while enhancing the value of FICON Dynamic Routing mentioned above. IBM is extending Workload Manager (WLM) Quality of Service (QoS) optimization that exists now for compute and storage to the SAN Fabric, allowing WLM policies to influence FICON traffic.
IBM zHyperWrite™ capability
Helps you achieve better DB2 log write performance when using Metro Mirror (PPRC) in a HyperSwap-managed environment. Log writes are sent directly to both DASD, freeing up Metro Mirror resources.
But don't just take my word for it, here are reviews of the new system from various journalists:
"They seem a computing odd couple: the mainframe, the old workhorse, and the smartphone, the cool-kid computer of today. But IBM has designed the latest version of the mainframe, which is being introduced on Wednesday, with the smartphone in mind. The new mainframe, the z13, has been engineered to cope with the huge volume of data and transactions generated by people using smartphones and tablets."
-- New York Times
"One customer enthusiastic about such features is Citigroup Inc., a longtime IBM user that favors mainframes for both reliability and security. 'Security is in the DNA of the mainframe,' said Martin Kennedy, Citi's managing director for platforms and storage. Another factor shaping the bank's needs, Mr. Kennedy said, is the rising volume of transactions carried out using smartphones and other mobile devices. Mainframes are particularly good at combining data from a variety of systems and presenting them to a user's mobile app, he said."
-- The Wall Street Journal
"IBM is introducing a new mainframe in a bet that clients will need its souped-up speed and security to handle a surge in consumers using smartphones for everything from banking to checking health-care records. The z13 system can encrypt and analyze data in real time and process 30,000 transactions a second, International Business Machines Corp. (IBM) announced today. That means faster and safer transactions for consumers on mobile phones."
"With the unveiling of the z13, IBM has taken its MobileFirst Platform to deliver even better performance and security than before, as it incorporates the fastest microprocessor in the world, server processors that are twice as fast as existing products, 300 percent additional memory and 100 percent more bandwidth analytics speed. Last year, IBM formed a partnership with Apple to help bring Apple's iDevices to business customers to boost sales, with IBM providing cloud and mobile analytics support."
-- The Street
"'We're driving toward a world where more and more people are using mobile devices, or embedded devices, to interact with systems,' John Birtles, director of IBM z Systems, tells WIRED. 'We need to make sure that those devices are secure, that the transaction's secure, and that our clients get the level of analytics that gives them opportunities to improve their businesses.'"
IBM mainframes are used to process the majority of financial transactions around the world, is well positioned to handle Cloud, Analytics, Mobile and Social workloads. The IBM DS8000 series disk is the #1 market leader for disk storage on mainframe environments.
Today in the USA, we honor [Martin Luther King, Jr.] This year marks the 50th anniversary of the largest political demonstration to date in American history. Over 250,000 people went to Washington DC to hear Dr. King give his now famous "I have a dream" speech.
Well it's Tuesday again, and you know what that means? IBM Announcements!
Today, IBM announced an exciting new addition to the IBM System Storage™ product line, [IBM Spectrum Storage™], a family of software defined storage offerings.
To understand its significance, I need to explain a few things first. Software defined storage is part of a larger concept of software defined environment.
How is software defined environment different than what you have now? In every data center, you need to map business requirements of an application workload with an appropriate set of IT infrastructure, including server, network and storage resources.
The traditional approach involves an application owner or database administrator reviewing the business requirements documented for the application, calling the server, network and storage administrators, who match those requirements to appropriate IT hardware and notify the folks in facilities to rack and stack the gear accordingly.
In a software defined environment, Application Programming Interfaces (API), Service Level Agreements (SLA) and Orchestration workflows can automate the request for the appropriate resources. This is referred as the "Control Plane".
Responding to these requests, the software can provision the appropriate server, network and storage resources required. Server, network and storage virtualization, standard interfaces and deployment technologies exist to make this practical. This is referred to as the "Data Plane".
Any time new a way of doing things is introduced into the world, there could be some resistance. Let's tackle the three most frequently stated objections:
"IT infrastructure resources are rare and expensive! Administrators need to control or approve how resources are doled out!" An objection to self-service automation is the fear that employees would take too much.
If you have a bank account, Automated Teller Machines (ATM) can restrict the amount of cash you can take out, based on what is appropriate per request, or per day, with an upper limit of what you have in your personal checking or savings account. You enter your debit card and PIN into the "Control Plane" keypad and out comes a stack of 20-dollar bills from the "Data Plane" slot. In a software defined environment, you can limit requests through quotas and resource pools.
"Some application workloads are more important than others! Another objection is that every workload will be treated in the same standard way, mission critical workloads and dev/test would be treated alike.
At the gas station, you can select different levels of octane gasoline. You enter your credit card and zip code into the "Control Plane" keypad and selected octane comes out of the "Data Plane" hose. In a software defined environment, resources can be provisioned with different Quality of Service (QoS) levels.
"Different applications require different combinations of resources!" Another objection is the fear that fixed combinations of server, storage and network resources will be stifling to innovation and productivity.
At the vending machine, you can choose which candy bar and which chips to have with whatever soft drink you choose for lunch. You enter your bills and coins into the "Control Plane" slot, select the row letter and column number for your snack of choice, and then fetch your purchases from the "Data Plane" flap. In a software defined environment, a Service Catalog can offer a virtual menu of different server, network and storage resources to be combined together as needed.
These concerns are addressed well enough in software defined environments, in general, and with IBM Spectrum Storage family of products, in particular.
(Nostalgia: I remember the days before self-service automation. At the bank, I had to stand in line at the bank until I could to talk to a human bank teller to get cash from my savings account. At the gas station, human gas attendants would come out and pump the gas for me, check my oil and wash my windshield. And at a restaurant, I felt like I waited an eternity from the time I ordered my meal to the time the human short-order cook had it ready and human wait staff delivered it to my table. These all seem silly today, doesn't it?)