This blog is for the open exchange of ideas relating to IBM Systems, storage and storage networking hardware, software and services.
(Short URL for this blog: ibm.co/Pearson )
Tony Pearson is a Master Inventor, Senior IT Architect and Event Content Manager for [IBM Systems for IBM Systems Technical University] events. With over 30 years with IBM Systems, Tony is frequent traveler, speaking to clients at events throughout the world.
Lloyd Dean is an IBM Senior Certified Executive IT Architect in Infrastructure Architecture. Lloyd has held numerous senior technical roles at IBM during his 19 plus years at IBM. Lloyd most recently has been leading efforts across the Communication/CSI Market as a senior Storage Solution Architect/CTS covering the Kansas City territory. In prior years Lloyd supported the industry accounts as a Storage Solution architect and prior to that as a Storage Software Solutions specialist during his time in the ATS organization.
Lloyd currently supports North America storage sales teams in his Storage Software Solution Architecture SME role in the Washington Systems Center team. His current focus is with IBM Cloud Private and he will be delivering and supporting sessions at Think2019, and Storage Technical University on the Value of IBM storage in this high value IBM solution a part of the IBM Cloud strategy. Lloyd maintains a Subject Matter Expert status across the IBM Spectrum Storage Software solutions. You can follow Lloyd on Twitter @ldean0558 and LinkedIn Lloyd Dean.
Tony Pearson's books are available on Lulu.com! Order your copies today!
Safe Harbor Statement: The information on IBM products is intended to outline IBM's general product direction and it should not be relied on in making a purchasing decision. The information on the new products is for informational purposes only and may not be incorporated into any contract. The information on IBM products is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. The development, release, and timing of any features or functionality described for IBM products remains at IBM's sole discretion.
Tony Pearson is a an active participant in local, regional, and industry-specific interests, and does not receive any special payments to mention them on this blog.
Tony Pearson receives part of the revenue proceeds from sales of books he has authored listed in the side panel.
Tony Pearson is not a medical doctor, and this blog does not reference any IBM product or service that is intended for use in the diagnosis, treatment, cure, prevention or monitoring of a disease or medical condition, unless otherwise specified on individual posts.
The developerWorks Connections Platform is now in read-only mode and content is only available for viewing. No new wiki pages, posts, or messages may be added. Please see our FAQ for more information. The developerWorks Connections platform will officially shut down on March 31, 2020 and content will no longer be available. More details available on our FAQ. (Read in Japanese.)
The question is if this is unique or specific to these particular models, or if this affects all kinds of blade servers because of their very nature and architecture. Stephen indicates that they also have HP C class enclosures, but since they are still in test mode, cannot comment on them.
I have no experience with any of HP's blade servers, but I have worked closely with our IBM BladeCenter team to help make sure that our storage, and our SAN equipment, work well together with the BladeCenter, and more importantly, that problems can be diagnosed effectively.
When I asked why people feel they need to know the inner workings of storage, the overwhelming response was to help diagnose problems. This could include problems inplacing related data on a potentially single point of failure, problems with performance, and problems communicating with 1-800-IBM-SERV.
So, if you have encountered problems diagnosing SAN problems with BladeCenter, or find that setting up an IBM SAN with blade servers in general, I would be interested in hearing what IBM can do to make the situation better.[Read More]
In case you missed it, IBMunveiled a new digital video surveillance service yesterday. This "marks an important shift in the industry's approach to security, applying advanced analytics to video data and signaling the ability to converge physical and information technology (IT) security."
The IBM Smart Surveillance Solution is designed to provide the unique capability to carry out efficient data analysis of video sequences either in real time or from recordings. These recordings can be on disk or tape storage.
The problem with today's existing "analog" surveillance is that the analog cameras record onto traditional VHS tapes, and these are rotated through, re-written after a few hours or days. To review tapes often involves human intervention, and must be done before the VHS tapes are re-used. Many shoplifters, thieves, and other law-breakers take a chance that their actions will not be caught on tape, or that they will be long gone by the time the video is analyzed.
The IBM Smart Surveillance Solution can provide a number of advantages over traditional video solutions, including:
Real-time alerts that can help anticipate incidents by identifying suspicious behaviors.
Forensic capabilities are enhanced by utilizing unique indexing and attribute-based search of video events to classify objects into categories such as people and cars.
Situational awareness of the location, identity and activity of objects in a monitored space including license plate recognition and face capture.
With real-time analytics capabilities, the new DVS service can open up a wide array of new applications that go far beyond the traditional security aspects of surveillance systems. Early adopter industries in this rapidly evolving market include retail, public sector and financial services. The retail industry estimates nearly $50 billion is lost annually to fraud, theft and administrative errors.
Once in digital format, video surveillance can be sent further, processed quicker, and stored for longer periods of time, than traditional media makes practical today.
Continuing this week's coverage of the 27th annual [Data Center Conference] I attended some break-out sessions on the "storage" track.
Effectively Deploying Disruptive Storage Architectures and Technologies
Two analysts co-presented this session. In this case, the speakers are using the term "disruptive" in the [positive sense] of the word, as originally used by Clayton Christensen in hisbook[The Innovator's Dilemma], andnot in the negative sense of IT system outages. By a show of hands,they asked if anyone had more storage than they needed. No hands went up.
The session focused on the benefits versus risks of new storage architectures, and which vendors they felt would succeed in this new marketplace around the years 2012-2013.
By electronic survey, here were the number of storage vendors deployed by members of the audience:
14 percent - one vendor
33 percent - two vendors, often called a "dual vendor" strategy
24 percent - three vendors
29 percent - four or more storage vendors
For those who have deployed a storage area network (SAN), 84 percent also have NAS, 61 percent also have some form or archive storage such as IBM System Storage DR550, and 18 percent also have a virtual tape library (VTL).
The speaker credited IBM's leadership in the now popular "storage server" movement to the IBM Versatile Storage Server [VSS] from the 1990s, the predecessor to IBM's popular Enterprise Storage Server (ESS). A "storage server" is merely a disk or tape system built using off-the-shelf server technology, rather than customized [ASIC] chips, lowering thebarriers of entry to a slew of small start-up firms entering the IT storage market, and leading to newinnovation.
How can a system designed for now single point of failure (SPOF) actually then fail? The speaker convenientlyignored the two most obvious answers (multiple failures, microcode error) and focused instead on mis-configuration. She felt part of the blame falls on IT staff not having adequate skills to deal with the complexities of today's storage devices, and the other part of the blame falls on storage vendors for making such complicated devices in the first place.
Scale-out architectures, such as IBM XIV and EMC Atmos, represent a departure from traditional "Scale-up" monolithic equipment. Whereas scale-up machines are traditionally limited in scalability from their packaging, scale-out are limited only by the software architecture and back-end interconnect.
To go with cloud computing, the analyst categorized storage into four groups: Outsourced, Hosted, Cloud, and Sky Drive. The difference depended on where servers, storage and support personnel were located.
How long are you willing to wait for your preferred storage vendor to provide a new feature before switching to another vendor? A shocking 51 percent said at most 12 months! 34 percent would be willing to wait up to 24 months, and only 7 percent were unwilling to change vendors. The results indicate more confidence in being able to change vendors, rather than pressures from upper management to meet budget or functional requirements.
Beyond the seven major storage vendors, there are now dozens of smaller emerging or privately-held start-ups now offering new storage devices. How willing were the members of the audience to do business with these? 21 percent already have devices installed from them, 16 percent plan to in the next 12-24 months, and 63 percent have no plans at all.
The key value proposition from the new storage architectures were ease-of-use and lower total cost of ownership.The speaker recommended developing a strategy or "road map" for deploying new storage architectures, with focus on quantifying the benefits and savings. Ask the new vendor for references, local support, and an acceptance test or "proof-of-concept" to try out the new system. Also, consider the impact to existing Disaster Recovery or other IT processes that this new storage architecture may impact.
Tame the Information Explosion with IBM Information Infrastructure
Susan Blocher, IBM VP of marketing for System Storage, presented this vendor-sponsored session, covering theIBM Information Infrastructure part of IBM's New Enterprise Data Center vision. This was followed by BradHeaton, Senior Systems Admin from ProQuest, who gave his "User Experience" of the IBM TS7650G ProtecTIER virtual tape library and its state-of-the-art inline data deduplication capability.
Best Practices for Managing Data Growth and Reducing Storage Costs
The analyst explained why everyone should be looking at deploying a formal "data archiving" scheme. Not just for "mandatory preservation" resulting from government or industry regulations, but also the benefits of "optional preservation" to help corporations and individual employees be more productive and effective.
Before there were only two tiers of storage, expensive disk and inexpensive tape. Now, with the advent of slower less-expensive SATA disks, including storage systems that emulate virtual tape libraries, and others that offer Non-Erasable, Non-Rewriteable (NENR) protection, IT administrators now have a middle ground to keep their archive data.
New software innovation supports better data management. The speaker recalled when "storage management" was equated to "backup" only, and now includes all aspects of management, including HSM migration, compliance archive, and long term data preservation. I had a smile on my face--IBM has used "storage management" to refer to these other aspects of storage since the 1980s!
The analyst felt the best tool to control growth is the "Delete" the data no longer needed, but felt that nobody uses Storage Resource Management (SRM) tools needed to make this viable. Until then, people willchose instead to archive emails and user files to less expensive media.The speaker also recommended looking into highly-scalable NAS offerings--such as IBM's Scale-Out File Services (SoFS), Exanet, Permabit, IBRIX, Isilon, and others--when fast access to files is worth the premium price over tape media.The speaker also made the distinction between "stub-based" archiving--such as IBM TSM Space Manager, Sun's SAM-FS, and EMC DiskXtender--from "stub-less" archive accomplished through file virtualization that employes a global namespace--such as IBM Virtual File Manager (VFM), EMC RAINfinity or F5's ARX.
She made the distinction between archives and backups. If you are keeping backups longer than four weeks, they are not really backups, are they? These are really archives, but not as effective. Recent legal precedent no longer considers long-term backup tapes as valid archive tapes.
To deploy a new archive strategy, create a formal position of "e-archivist", chose the applications that will be archived and focus on requirements first, rather than going out and buying compliance storage devices. Try to get users to pool their project data into one location, to make archiving easier. Try to have the storage admins offer a "menu" of options to Line-of-Business/Legal/Compliance teams that may not be familiar with subtle differences in storage technologies.
While I am familiar with many of these best practices already, I found it useful to see which competitiveproducts line up with those we have already within IBM, and which new storage architectures others find mostpromising.
Twenty years ago, I flew to Atlanta for the semi-annual SHARE conference. I was a lead architect for DFSMS, the storage management software for mainframe servers. When I got to the hotel, I realized that I had forgotten to pack my saline solution for my contact lenses. I went to the hotel gift shop, and picked the first one I found. I took my contacts in the solution and went to bed.
The next morning, I put on my contacts, got dressed, and participated in meetings. One of my colleagues noticed my eyes were quite red, and suggested I switch from contact lenses to glasses. I went back to my hotel room, saw to my horror that what I thought was saline solution was actually hydrogen peroxide intended for hard lenses. When I removed the lenses, all I could see was white light.
I managed to find my way to the elevator, and feel for the button with the star that indicated the lobby on the ground floor. I asked a hotel staffer to call me an ambulance, but instead, they put me in a cab, and sent me to Emory Hospital. On arrival, all I could do was hand over my wallet to my cabbie, and let him take out what he felt was fair, since I could not see him, the meter, or his license number.
After bumping my knees into dozens of cars in the parking lot, I finally made it to the ER, only to have receptionist give me a form to fill out and a pen. At this point, I lost it. I gave her my wallet and said that any information she may need should be in there.
Thankfully, a doctor noticed this exchange, and took care of me right away. I had chemically burned off both corneas. He injected some green fluid into both eyeballs, and sent me off in a cab to the Pharmacy. At least I had both eyes were bandaged in gauze, so people were kind enough to take me to get to the counter to get my pain killers, Percocet.
The pharmacist provided me the pills, and warned me NOT to operate any heavy machinery under the influece of this medication. Seriously? I can't see, both eyes covered, and he tells me that?
I got back to the hotel, got ready for bed, took the pills and brushed my teeth. I woke up the next morning on the bathroom floor, still clutching the toothbrush, and vertical and horizontal lines across my right cheek which were made by the one-inch tiles of the bathroom floor. These pills really knocked me out.
That day, I had to present a full hour in front of hundreds of people. I had a colleague flip my transparencies for me, while I spoke to each one, my eyes still covered in gauze. That evening, I was one of the experts on the panel for a "Birds of a Feather", or BOF session, answering a variety of questions. People could see that I was blind, but I could still hear the questions, and I could still answer them as well.
If you are going to Edge 2013 in Las Vegas, please consider attending my BOF session on Security for PureSystems, System x and Storage products, scheduled for Thursday afternoon, June 13. I will be moderating a distinguished panel of experts to answer your questions! I have listed them here alphabetically:
Jack Arnold, US Federal. Jack has worked decades in the storage industry, and will provide insight into security issues related to the government.
Tom Benjamin, Development Manager for Key Lifecycle Management and Java Cryptography. Tom will bring his expertise in both TKLM and ISKLM for managing encryption keys, and how to communicate these between security and storage administrators.
Paul Bradshaw, Chief Storage Architect for Clouds. A research scientist from IBM's Almaden Research Lab, Paul will provide insight in how to deal with security issues related to private, hybrid and public cloud deployments.
Ajay Dholakia, Solution Center of Excellent. Ajay will cover server-side considerations for security deployments, including System x and PureSystems.
Jim Fisher, Advanced Technical Skills. Jim brings expertise related to deploying data-at-rest encryption.
Not sure what kind of questions to ask? Here is a series of Questions and Answers we had at a Storage event in 2011 that might give you a good idea: [2011 Storage Free-for-All].
This week, I am attending the [InterConnect Conference] in Las Vegas, Feb 21-25, 2016. This is IBM's premier Cloud & Mobile conference for the year.
4955A IBM and Box: Delivering Hybrid Solutions for Enterprise Content Management
Rich Howarth, IBM VP of Enterprise Content Management, and Rand Wacker, Vice President at Box, co-presented this session on the [IBM-and-Box partnership], integrating content management, social and analytics products with the Box cloud content management offering to enable enterprise customers to deploy hybrid solutions leveraging the best of their existing on-premise technologies along with new cloud technologies.
IBM and Box are partnering to re-imagine content management, case management and governance in the cloud. For example, IBM StoredIQ that scans various data sources to find documents and evidence needed to defend yourself against lawsuits can be run against files uploaded to Box.
On a personal note, the IBM Tucson Executive Briefing Center where I work now uses Box to upload presentation files that are then sent to the client attendees.
6524A The Role of Tape in a Cloud-Based World for Economical and Secure Data Retention
This was a 50/50 session. The first half was presented by Shawn Brume, IBM, that covered Linear Tape File System (LTFS) and IBM Spectrum Archive.
Like the cloud, tape has made great strides -- evolving independently in capacity, durability and data access capability while maintaining its economic benefits. As a result, today's tape is just as well suited to cloud service providers as it is to the enterprises and midsize organizations that rely on it to support their production and data protection strategies.
If a cloud service provider does not use tape, the provider and its customers are almost guaranteed to experience a long-term cost outlay that is higher than necessary, and will be putting their oldest and most compliance-sensitive data at risk, thanks to a disk-only based MSP model. See how incorporating tape into your storage strategy can reduce costs and improve MSP margins.
How does tape compare to disk for Cloud providers? A [Zettabyte] of data would cost $41 billion USD per year on disk, but only 8 billion USD per year on tape. Electricity for a Zettabyte of data requires 1.2 Gigawatt for disk, but only 300 Megawatt for tape.
For access to files that require a tape mount, an access time to first byte averages 45 seconds, with a worst case around 75 seconds. After that, tape can stream data as fast as the Internet can deliver it, so performance is not an issue beyond first byte access.
The second half was presented by Michael Piltoff, from value-added reseller Champion Solutions Group, covering their latest product called EchoLeaf. This can run on Windows or Linux that attaches to any IBM tape library, and exports the files on those cartridges as NFS or CIFS/SMB.
In other words, the entire library appears as a single mount point or drive letter, and each tape cartridge appears as a sub-directory. This uses IBM Spectrum Archive Library Edition under the covers.
4759A Cloud Storage Success: MSPs and Enterprises Reveal their Secrets
How do you distinguish fact from fiction when it comes to claims made by vendors about storage for cloud? Eric Herzog, IBM Vice President Marketing for IBM Storage Systems, served as emcee for a panel of experts using IBM Storage solutions across different industries for their Hybrid Cloud deployments.
The panel shared their experiences in using various technologies to get the most out of their private and hybrid cloud, discussed how they are building out their next-gen data centers to cope with today's business needs, talked about how they are using flash and software defined storage to place them where they need to be to succeed in the future.
On the panel were:
Richard Spurlock, Cobalt Iron, using PB of storage on Spectrum Scale and Cleversafe
Paul Rafferty, IBM Silverpop, using Spectrum Accelerate with different Cloud providers
Johnny Oldenburg, Tieto Sweden AB, using SVC, Storwize V7000 and FlashSystem
Keith Dobbins, Time Warner Cable/Navisite, over 30 fully-populated XIV storage systems
Here were some of the nuggets of wisdom:
Eliminate the debate between private or public cloud. Consider everything to be a unique shade of Hybrid Cloud.
Get the network right, all data and management control is done through the network in the Cloud
Take an "Outside-In" approach, focusing on the business problems being solved, rather than trying to exploit specific technologies.
Workloads are unpredictable in the Cloud. Cloud can sometimes be unreliable in their response to workload changes. Partner with vendors like IBM to provide support and scalability to handle the unexpected.
Ensure that you comply with government and industry regulations. For example, Payment Card Industry Data Security Standard [PCI-DSS] for credit card transactions.
Use VMware Storage Vmotion and VVols to migrate data from one Cloud to another.
Software defined network (SDN) and Software Defined Storage (SDS) greatly automate the provisioning process, pushing many storage admin tasks down to NOC personnel.
Use tools like Spectrum Control to provide a single-pane-of-glass management of your entire environment.
Build abstraction layers at touch points to avoid being impacted by external changes, and use documented reference architectures to ensure success.
Educate your clients and end-users on what is possible, and what is probable, in the Cloud.
Use "Flash Cache" technologies, such as IBM XIV, Oracle, Spectrum Scale, and VMware.
Analytics can help with "data rationalization", which identifies the business value of the data.
Object Store is a first-class citizen and should seriously be considered for new projects.
5467A My Data is Out of Control! Managing the Lifecycle of Your Data with "Big Storage" Cloud Archive
Jeff Karmiol and Quaid Nasir, both from IBM, presented a technology preview of a deep archive to be launched later this year.
A staggering 80 percent of data is never touched after 90 days of capture or creation. However, the data may need be kept for business, compliance or regulatory reasons.
"Big Storage" offers cloud storage for customers who need to store large amounts of data and retrieve it on-demand at the lowest cost possible. This easy-to-use cloud service provides fast retrieval times with affordable, transparent pricing and retrieval rates.
This service uses standard OpenStack Swift and POSIX interfaces so you don't need to learn any new APIs. Files and objects remain visible while archived, making it easy and affordable to continue to extract business value from your archived data.
This deep archive is located in a secure, IBM-managed data center. How deep? The facility is 350 feet deep under a mountain, which allows that tape cartridges to be kept at constant humidity and 40 degree Fahrenheit temperature.
Multiple resiliency and data protection options will be available. The data can be part of a global namespace, with some data on premises, connected to data migrated to the archive. Data movement can be either manually-initiated or policy-managed.
7256: Blogging 301: The Art of Opinion
"Turbo" Todd Watson and I started blogging 10 years ago, and we have both been ranked in the top-10 bloggers for IBM. He presented a series covering the basics of blogging. This session was a deeper dive into best writing practices and structures for being confident, engaging, and convincing in their writing.
Here are some of his bits of wisdom:
Base your opinions on fact and well-research information.
Educate your readers, without being "preachy"
Generate interest and enthusiasm, and encourage readers to participate
Don't equivocate, pick a position or side of a debate and stick with it
Leave your reader with the next logical step, a call to action, or pointer to additional information
Today I spoke at the IBM Think Green Roadshow in Phoenix, Arizona. This is justone of a 15-city tour to help make people aware of Green data center issues.Here is the schedule forthe remaining cities. Contact your local IBM rep for details.
Victor Ferreira was our moderator and host. He is the site level executive for the2000 IBM employees in the Phoenix area, and manages the Public Sector for our Westernregion.
The first speaker was Dave McCoy, IBM principal in our Data Center services group.He explained IBM's Project Big Green and the Energy Efficiency Initiative, and wentinto details on how IBM can act as general contractor to design, plan and build theideal Green Data Center for you. IBM can also retrofit existing buildings, with new technologies like stored cooling, optimized airflow assessments, and modulardata center floorspace. While not related to energy, but still important to ourenvironment was IBM Asset Recovery Services, where IBM can take all those old PCmonitors, keyboards and other outdated equipment and refurbish or melt down to recapture useful metals and plastics, and disposing the rest in an environmentally-friendly,non-toxic manner.
I was the second speaker, covering "How to get it done". While Dave covered the issuesand technologies available, I explained how to put it all into practice. This includesIT systems assessments, health audits, and thermal profiling. Using server and storagevirtualization, you can increase resource utilization and reduce energy waste. IBM's CoolBlueproduct line, which includes the IBM PowerExecutive software to monitor your IT environment, and the "Rear Door Heat Exchanger" that uses chilled water to remove asmuch as 60% of the heat coming out of the back of a server rack, greatly reducing hot-spotson the data center floor, and allowing you to run the entire room at warmer, less-expensivetemperatures.
On the server side, I covered IBM's System z mainframe and the BladeCenter as examples of how innovative technologies can be used to run more applications with less energy. The newSystem p570 based on the energy-intelligent POWER6 processor has twice the performance for the same amountof power as its POWER5 predecessor. On thestorage side, I explained how Information Lifecycle Management (ILM), storage virtualization,and the use of a blended disk and tape environment can greatly reduce energy costs.
Reps from our many technology partners Eaton, APC, Schneider Electric, Liebert, and Anixter werethere to support this event.
The session ended with a Q&A Panel, with Dave McCoy, myself, and Greg Briner from IBM GlobalFinancing. IBM is able to offer creative "project financing" that can often times match theactual monthly savings, resulting in net zero cost to your operational budget, with payback periods as little as 2.5 years.
To learn more about IBM's efforts to help clients create "Green" data centers, clickGreen Data Center.
Well, tomorrow is the Winter solstice, at least for those of us in the Northern hemisphere of the planet.As often happens, I have more vacation days left than I can physically take before they evaporateat the end of the year, so next week I will be off, going to see movies like the new["Golden Compass"]or perhaps read the latest book from [Richard Dawkins].
Next week, I suspect some of the kids on my block will be playing with radio-controlled cars orplanes. If you are not familiar with these, here's a [video on BoingBoing]that shows Carl Rankin's flying machines that he made out of household materials.
Which brings me to the thought of scalability. For the most part, the physics involvedwith cars, planes, trains or sailboats apply at the toy-size level as well as the real-world level. One human operator can drive/manage/sail one vehicle. While I have seen a chess master play seven opponents on seven chess boards concurrently, itwould be difficult for a single person to fly seven radio-controlled airplanes at the same time.
How can this concept be extended to IT administrators in the data center? They have to deal withhundreds of applications running on thousands of distributed servers.In a whitepaper titled [Single System Image (SSI)], the threeauthors write:
A single system image (SSI) is the property of a systemthat hides the heterogeneous and distributed nature of theavailable resources and presents them to users and applicationsas a single unified computing resource.
IBM has some offerings that can help towards this goal.
Even in the case where yourvehicle is being pulled by eight horses--(or eight reindeer?)--a single operator can manage it, holding the reins in both hands. In the same manner,IBM has spent a lot of investment and research into supercomputers, where hundreds of individualservers all work together towards a common task. The operator submits a math problem, for example,and the "system system image" takes care of the rest, dividing the work up into smaller chunksthat are executed on each machine.
When done with IBM mainframes, it is called a Parallel Sysplex. The world's largest business workloadsare processed by mainframes, and connecting several together and working in concert makes this possible.In this case, the tasks are typically just single transactions, no need to divide them up further, justbalance the workload across the various machines, with shared access to a common database and storageinfrastructure so they can all do the work equally.
Last August, in my post [Fundamental Changes for Green Data Centers], I mentioned that IBM consolidated 3900 Intel-based servers onto 33 mainframes. This not only saves lots of electricity, but makes it much easier for the IT administratorsto manage the environment.
Parallel Sysplex configurations often require thousands of disk volumes, which would have been quitea headache dealing with them individually. With DFSMS, IBM was able to create "storage groups" wherea few groups held the data. You might have reasons to separate some data from others, put them inseparate groups. An IT administrator could handle a handful of storage groups much easier than thousandsof disk volumes. As businesses grow, there would be more data in each storage group, but the numberof storage groups remains flat, so an IT administrator could manage the growth easily.
IBM System Storage SAN Volume Controller (SVC) is able to accomplish this for other distributed systems.All of the physical disk space assigned to an SVC cluster is placed into a handful of "managed diskgroups". As the system grows in capacity, more space is added to each managed disk group, but few IT administrators can continue to manage this easily.
The new IBM System Storage Virtual File Manager (VFM) is able to aggregate file systems into one globalname space, again simplifying heterogeneous resources into a single system image. End users have a singledrive letter or mount point to deal with, rather than many to connect to all the disparate systems.
Lastly we get to the actual management aspect of it all. Wouldn't it be nice if your entire data centercould be managed by a hand-held device with two joysticks and a couple of buttons? We're not quite there yet, but last October we announced the [IBM System Storage Productivity Center (SSPC)]. This is a master consolethat has a variety of software pre-installed to manage your IBM and non-IBM storage hardware, includingSAN fabric gear, disk arrays and even tape libraries. It lets the storage admin see the entire data centeras a single system image, displaying the topology in graphical view that can be drilled down using semanticzooming to look at or manage a particular device or component.
Customers are growing their storage capacity on average 60 percent per year. They could do this by havingmore and more things to deal with, and gripe about the complexity, or they can try to grow theirsingle system image bigger, with interfaces and technologies that allow the existing IT staff to manage.
This week, I am attending the [InterConnect Conference] in Las Vegas, Feb 21-25, 2016. This is IBM's premier Cloud & Mobile conference for the year.
The last day of the conference had fewer people. Many stayed for the Elton John concert then left. I am glad to be one of the few that squeezed out every last value of learning from the money it cost for my employer to send me here.
2419A Enhance the Agility of Your Cloud with IBM FlashSystem
Kristy Ortega and Shaluka Perera, IBM FlashSystem Solutions team, presented. Cloud Service Providers (CSP) and Managed Service Providers (MSP) are leveraging flash technology for a variety of reasons:
To meet Service Level Agreements (SLAs)
To handle unpredictable workloads
To minimize noisy neighbor interference
To offer premium performance as an up-sell feature
To be able to scale faster to meet incoming requests
To reduce server count
To keep custonmers delighted and reduce customer churn
To offer data-rich features without sacrificing performance
Kristy gave three practical client use cases:
IP-Only -- an MSP in the Nordic countries, employed IBM FlashSystem and Storwize V5000. They achieved five times VMware density on their servers and 300 percent improved application performance. Nearly all of the cost of the new storage hardware was offset by the savings in VMware license costs!
Cageka -- an MSP in Europe, employed IBM FlashSystem and SAN Volume Controller. They achieved 66 percent reduced SAP ERP response time, 97 percent reduction in floorspace, and 95 percent reduced power and cooling costs.
COCC -- formerly the Connecticut On-Line Computer Center, a CSP for bank and credit unions, employed IBM FlashSystem with IBM POWER servers. They achieved 10x faster OLTP transaction processing times, 80 percent reduction in power and cooling costs. The payback period for this was less than 3 months!
IBM sells SAN switches featuring Brocade Gen5 "Fabric Vision" technology, and resells Cisco MDS switches like the 9396S model. Both of these have been enhanced to handle the lower latency and higher throughput that IBM FlashSystem provides.
IBM Data Engine for NoSQL employs Redis with Coherent Accelerator Processor Interface (CAPI) that allows POWER8 servers to connect directly to IBM FlashSystem as an extension of memory rather than bus-attached external storage. This reduces the code path length to read/write to IBM FlashSystem by 97 percent, resulting in solutions that use six times less rack space, and three times less costs. This solution reduces CPU core requirements by 20-30 cores for every 1M IOPS of workload!
Spectrum Scale supports IBM FlashSystem in a variety of configurations. First, IBM FlashSystem can serve as a high-speed cache when Spectrum Scale virtualizes other NFS storage devices. Second, IBM FlashSystem can serve as a low-latency storage pool to direct new or hot data to. Third, Spectrum Scale can separate its metadata from the content of files and objects, putting the metadata on IBM FlashSystem. This greatly improves searching through directory structures or for specific object attributes.
Last year, IBM, Hewlett-Packard, and VMware launched Project Capstone to "leave no application behind". They made a concerted effort to make sure that all relevant applications that run on bare metal can also run on VMware hypervisor. IBM FlashSystem has support for VMware features, including VAAI, VASA, and VVols.
IBM has partnered with Atlantas ILIO to offer in-line data deduplication for Virtual Desktop Infrastructure (VDI). A single 2U IBM FlashSystem can support 5,000 users and 10,000 virtual desktops, running at 382 IOPS per desktop.
Lastly, Healthcare provider Trizetto has used IBM FlashSystem to reduce OPEX by 90 percent, shrinking from a 20U disk system array to a 2U IBM FlashSystem device.
4331A Leverage zOS and Cloud Storage for Backup/Archive Efficiency and Cost Reduction
Eddie Lin, IBM Senior Technical Staff Member for DS8000 development team, presented this technology preview. Taking advantage of cloud storage is not limited to the distributed storage world alone. The ability to connect existing archive and backup solutions in z/OS to on-premise object storage platforms provides huge efficiency gains, enabling clients to do more during their critical batch windows.
IBM is integrating cloud gateway software into its DS8870 and DS8880 Enterprise Disk Systems in conjunction with DFSMShsm and DFSMSdss for a complete end-to-end solution to optimize this space. We will show a live demonstration of this capability during this session.
This solution uses the Storage-as-the-Storage-Cloud methodology I mentioned in my session yesterday. DS8000 is #1 storage provider for mainframe environments. Eddie explained the current inefficient process of moving cold data to tape, using 37-year-old DFSMShsm functionality.
A new approach involves moving data directly from DS8870 storage systems to object storage, either on-premises or off-premises. This eliminates MIPS used for data movement, and reduces the record-keeping normally done by DFSMShsm. z/OS Data sets migrated to the Cloud will continue to be designated as MIGRAT in the ICF Catalog. Similar recall times from tape or Cloud.
There will also be options for DFSMSdss to invoke the function. However, you will need to provide in the DFSMSdss command parameters all of the information needed to connect to the Cloud that would normally be handled by DFSMShsm.
To make this all happen, you will need a certain level of DFSMS, and a certain level of DS8000 firmware. No new hardware is required, as it uses 1GbE Ethernet ports that already exist in DS8870 and DS8880 models. If you still have DS8100, DS8300, DS8700 or DS8800 models, now is a good time to start upgrade!
Internal tests on a 5GB data set were done to compare MIPS consumption. With DFSMShsm, 0.127 CPU, versus this new "Transparent Cloud Storage Tiering" method was only 0.068 CPU, indicating a 46 percent reduction in MIPS. DFSMShsm is often the #2 biggest consumer of MIPS (DB2 is #1), so any reduction here is a big deal.
IBM plans to support Spectrum Scale, Cleversafe, IBM SoftLayer, Amazon S3, Rackspace, Microsoft Azure. Full encryption data-in-flight is included, with keys managed using IBM SKLM. This capability will be fully supported by z/OS Security products (RACF, Top Secret, etc.) and z/OS audit logging.
Eddie wrapped up with a live demo.
7341A IBM Storage and Catalogic: Software Defined Solutions for Hybrid Cloud and DevOps
Third party Catalogic ECX software supports IBM, NetApp and EMC storage devices. I was hoping to hear how it works specifically with IBM storage models, but instead the speaker explained why Copy Data Management (CDM) was helpful for Bi-Modal environments.
Basically, copies of data taken to protect production data sit idle until needed. With Copy Data Management, the copies are available to development and test personnel. While traditional production IT operations are like Marathon runners, the new DevOps is like short-distance sprinters, needing to be agile in developing and testing new applications. Having ready access to copies of production data can speed this process.
4921A Radical Storage Simplicity for Your Cloud and How it Can Impact Your Customers
Diane Benjuya and Yafit Sami, both from IBM, presented IBM Spectrum Accelerate, the software "de-coupled" from traditional XIV hardware.
The XIV grid architecture automatically distributes data, eliminates hot-spots, and provides enterprise-class features like thin provisioning, VMware support, snapshots and remote mirroring. It's "Distributed RAID-10" capability can rebuild after the loss of a 6TB disk drive failure in less than an hour.
Spectrum Accelerate has nearly the same set of features, minus Microsoft Hyper-V integration, FCP host access support, VMware vSphere v6 VVol support, Real-time Compression, and Encryption. Spectrum Accelerate adds a feature not available to XIV called Hyperconvergence. This allows application Virtual Machines to run on the same servers used for Spectrum Accelerate. Spectrum Accelerate can run on-premises on customer-choice hardware, or in the Cloud, such as IBM SoftLayer.
In response to complaints that IBM XIV was a single-frame storage array, IBM introduced Hyper-Scale, a series of features that allow up to 144 XIV Gen3 frames as a single system. With the introduction of Spectrum Accelerate, Hyper-Scale Manager can now manage any combination of XIV Gen3 and Spectrum Accelerate clusters, on-premises or off-premises, up to 144 total.
Hyper-Scale Mobility can migrate volumes from one XIV to another without the need for external virtualization such as IBM SAN Volume Controller. For iSCSI volumes, Hyper-Scale Mobility can migrate data between XIV and Spectrum Accelerate, or from one Spectrum Accelerate cluster to another, on-premises with off-premises.
Hyper-Scale Consistency allows Snaphots to be taken of a group of volumes across multiple XIV frames. Now, snapshots can be taken of a group of volumes across both XIV and Spectrum Accelerate clusters.
Remote Mirroring is fully supported. You can replicate data from XIV to Spectrum Accelerate, Spectrum Accelerate to XIV, or from one Spectrum Accelerate cluster to another.
The IBM XIV Mobile Dashboard for Apple and Android phones can support any mix of XIV and Spectrum Accelerate clusters. This includes monitoring your environment, as well as push notifications.
IBM has also introduced flexible licensing options. With newly purchased XIV boxes and Spectrum Accelerate, you can choose to buy the software license as "perpetual", allow you to move it to new hardware when your hardware kicks the bucket. This license can be moved to new XIV hardware, or to Spectrum Accelerate cluster deployment.
For Spectrum Accelerate, an additional license option is "monthly", allowing you to elastically add or reduce the amount of storage you manage, either on-premises or off-premises.
Like the idea of Spectrum Accelerate but don't want to build it yourself? Third party SuperMicro offers hardware pre-certified and pre-installed with Spectrum Accelerate. You license Spectrum Accelerate directly from IBM, and SuperMicro will take care of the rest.
Spectrum Accelerate is a component of the Spectrum Storage suite. A single flat-TB pricing for all six Spectrum Storage products.
Want to try IBM Spectrum Accelerate yourself? Here are three options:
Free 90-day trial with self-destruct. After 90 days, the code stops working. You can download this and try it out.
90-day evaluation copy. Your authorized IBM Seller works with you to install, and if you like it, you buy it after 90 days to continue to use it.
Special promotion before June 30, 2016 -- Purchase IBM Spectrum Accelerate for production, and your first 20TB are free. No strings attached.
IBM's Silverpop uses IBM Spectrum Accelerate to deploy their market analytics solution. They can spin up a new customer with 250TB of capacity in 24-48 hours on IBM SoftLayer. They found they use half as many storage admins managing storage with IBM Spectrum Accelerate than their previous method.
Well, that's the end of the conference. I have to go back and submit all of my survey responses, which I should have done every day all along, but was too busy writing blog posts!
The presentations are also now available for download for those who attended the conference. (Go to Session Preview on the IBM InterConnect attendee website and hit the Download Presentation button)
On Wednesday, I walked through the gardens of [The Grotto] on Sandy Blvd, ate a German lunch at [The Rheinelander], then visited the [Crown Point Vista House] along the [Columbia River Gorge]. There were several fabulous waterfalls that could be seen from the parking area without hiking into the wilderness. We wouldn't want to encounter a bear in the woods, or a cow in the field!
Afterwards, I drove to the [Timberline lodge] at the peak of Mt. Hood to watch the snow fall and have dinner and drinks. This is the lodge featured in the movie ["The Shining"].
Thursday was a Spa day, which I spent relaxing at the pool and sauna. In the evening, I had dinner at [Henry's Tavern], and then shopped at [Powell's Books].
In the afternoon, Rafael, Mo and I explored Portland's waterfront and various bridges via [Segway tour]. The cherry blossoms along our path were in full bloom. If you have not ridden on one of these Segway scooters, they are a lot of fun!
On Saturday, Portland held their [Saturday Market] with arts and crafts for sale. This is similar to Tucson's 4th Avenue Street fair. The difference is that the "Saturday Market" occurs every Saturday of the year and Tucson's 4th Avenue Street Fair occurs only twice per year. The weather was very nice, so, many of the locals were in t-shirts and shorts. A live concert by [Grupo Condor] were playing on the main stage.
I walked past the [Voodoo Donuts store]. There was a long line to get in. A woman leaving the store carrying a pink donut box complained she waited 2 hours just to spend $28 for a dozen donuts. The magic is in the hole!
Getting out of the hustle and bustle of the Saturday Market, I had some green tea at the [Lan Su Chinese Garden]. A sister city to Portland is Suzhou, China, and this garden was very peaceful to walk through.
I went back to Powell's Books, did some shopping for shoes at [Dr. Martens], and had some pizza and salad at [Sizzle Pie] next door.
Nearly everything was closed on Easter Sunday, so I went down to the [TulipFest at the Wooden Shoe Tulip Farm] in Woodburn, OR. This was the opening weekend, with over 40 acres of flowers to walk through, various food carts, wine tasting, and rides for the kids.
Getting back to Tucson proved to be a bit challenging. The flight from Portland to San Francisco was delayed due to fog, so we got re-routed to Seattle, then back to Los Angeles, and finally to Tucson.
Before acquisition, Diligent offered only software. The task of putting this software on an appropriate x86 server with sufficientmemory and processor capability was left as an exercise for the storage admin. With the TS7650G, IBM installs theProtectTIER software on the fastest servers in the industry, the IBM System x3850 M2 and x3950 M2. This eliminateshaving the storage admins pretend that they have hardware engineering degrees.
Before acquisition, the software worked only on a single system. IBM was able to offer multiple configurations of the TS7650G, including a single-controller model as well as a clustered dual-controller model. The clustered dual-controller model can ingest data at an impressive 900 MB/sec, which is up to nine times faster than some of thecompetitive deduplication offerings.
Before acquisition, ProtecTIER emulated DLT tape technology. This limited its viability, as the market sharefor DLT has dropped dramatically, and continues to dwindle. Most of the major backup software support DLT as anoption, but going forward this may not be true much longer for new tape applications.IBM was able to extend support by adding LTO emulation on theTS7650G gateway, future-proofing this into the 21st Century.
At last week's launch, covering so many products with so few slides, this announcement was shrunken down to a single line "Store 25 TB of backups onto 1 TB of disk, in 8 hours" and perhaps a few people missed that this wasactually covering two key features.
With deduplication, the TS7650G might get up to 25 times reduction on disk. If you back up a 1 TB data basethat changes only slightly from one day to the next, once a day for 25 days, it might only take 1 TB, or so, of disk tohold all the unique versions, as most of the blocks would be identical, rather than 25 TB on traditional disk or tapestorage systems. The TS7650G can manage up to 1 PB of disk,which could represent in theory up to 25 PB of backup data.
With an ingest rate of 900 MB/sec, the TS7650G could ingest 25 TB of backups during a typical 8 hour backup window.
The 25 TB of the first may not necessarily be the 25 TB of the second, but the wording was convenient for marketingpurposes, and a comma was used to ensure no misunderstandings.Of course, depending on the type of application, the frequency of daily change, and the backup software employed, your mileage may vary.
Oh my, it is Tuesday again, and you know what that means? IBM Announcements!
This week, IBM announced its latest storage arrays in its IBM System Storage DS8000 series: the DS8880 models. Similar to the "Business Class" vs. "Enterprise Class" distinctions of the DS8870, IBM announced two new models, the DS8884 and the DS8886.
All of the new DS8880 models are based on the latest IBM POWER8 processors, and are noticeably thinner! These are now standard 19-inch wide, fitting nicely into standard IBM racks alongside most other standard 19-inch rack equipment.
The DC-UPS that used to be on the side are now at the bottom of each frame, taking up 8U of space. The High Performance Flash Enclosures (HPFE) that formerly were stored vertically above the DC-UPS will be stored horizontally with the rest of the HDD and SSD drives.
The DS8884 will have 6-core controllers, up to 256 GB Cache, 64 ports that can negotiate between 16Gbps and 8Gbps, up to 240 drives in a single-rack configuration or 768 drives in a three-frame configuration, and up to 120 flash cards in HPFEs. The performance of this one is equal or better to existing DS8870 systems.
The DS8886 will have 8-core, 16-core and 24-core controllers, offering up to three times the performance as the previous DS8870 models, with up to 2 TB of Cache, 128 ports, up to 1,536 drives across five frames, and up to 240 flash cards in HPFEs.
Field model conversion from DS8870 to DS8886 is available for existing clients with DS8870 Enterprise Configurations. This will let clients move their existing HDD, SSD, HPFE and Host Adapters over to the new DS8880 models.
In previous DS8000 models, clients would have one Hardware Management Console (HMC) inside the array, and an optional second HMC workstation somewhere else for high availability. While the second one was optional, it was always considered best practice to have it for redundancy sake. In the new DS8880 models, you can have both HMC in the array, and the Keyboard/Video/Monitor (KVM) can select between the two.
The new I/O enclosure pairs are four times faster, supporting six Device Adapters and two HPFE connections over PCIe Gen 3 network, the fastest available in the industry.
Lastly, IBM simplified the licensing of software features into three bundles, based on TB total capacity of Fixed Block (FB) LUNs and Count-Key-Data (CKD) volumes:
Base function License: Logical Configuration support for FB, Operating Environment License, Thin Provisioning, Easy Tier® automated sub-volume tiering, and I/O Priority Manager.
Copy Services License: FlashCopy®, Metro Mirror, Global Mirror, Metro/Global Mirror, z/Global Mirror (XRC), z/Global Mirror Resync, and Multi-Target PPRC.
z-Synergy Service License: Parallel Access Volumes (PAV), HyperPAV, FICON® attachment, High performance FICON (zHPF), and IBM z/OS® Distributed Data Backup (zDDB).
IBM also provided a "Product preview", announcing plans for a third member of the DS8880 family in 2016 that will be flash-optimized to provide an all-flash, higher performance storage system model.
Well, I have left Japan, and while everyone else is enjoying the Super Bowl, I am now in Australia, at another conference.Today I had the pleasure to hear filmmakers talk about their successes, and how IBM helps the movie industry.
At one extreme was Khoa Do, independent filmmaker. After acting in movies asideMichael Caine and Billy Zane, he decided to become his own director. He started a project to help seven disadvantaged youths from a poor drug-ridden section of Sydney, by having them act in his first full-length film.Armed with only an IBM laptop and small budget, he made the film called "The Finished People" that had critical acclaim.
The film was a success, and many of the disadvantaged youths have gone on to act in other movies. In 2005, Khoa Do was named "Young Australian of the Year".
Thanks to IBM technology, filmmaking is now accessible to a wider number of aspiring wanna-be directors. It is no longer necessary to be part of a large film studio with a multi-million dollar budget to tell your story.
At the other extreme, was Xavier Desdoigts, director of technical operations at Animal Logic, the Computer Graphics (CG) arthouse that produced special effects of movies like "The Matrix", "House of Flying Dragons" and "World Trade Center". They started with producing digital effects for TV commercials, like this one forCarlton Draught Beer.
With the support of a large film studio and multi-million dollar budget, Animal Logic now boasts the 86th most powerful "Supercomputer" based on IBM BladeCenter technology, with over 4000 servers connected into a cluster, for making the movie "Happy Feet". The movie took four years to make, with over 500 people, of 27 different nationalities. It was the first CG movie made in Australia, and has been well-received by audiences worldwide.
Mr. Desdoigts gave out some interesting facts and figures about the movie:
While visually stunning on the big screen, each frame is only 1.4 Megapixel, about the same resolution as most camera phones.
In one scene, there are 427,086 penguins all appearing on frame.
Mumble, the lovable lead character, is made up of over 6 million feathers.
As many as 17 dancers were "motion-captured" to choreograph the tap-dancing and character interaction segments.
Only one system admin was needed to manage this entire server farm. (IBM Systems Director technology makes this possible)
The movie consumed 103 TB of disk space, backed up to 595 LTO tape cartridges.
An estimated 17 million CPU-hours were needed for all the processing and rendering.
Rather than talking about technology for technology sake, these filmmakers showed how technology couldbe put to use, in a practical sense, to provide the world something of value.
My IBM colleague Marissa Benekos brought her hand-held video camera to [Storage Networking World] conference in Orlando, Florida.I am not there, as I had a conflict with another conference going on here in Tucson, so am relyingon Marissa to feed me information to blog about.
In this segment, she interviews "booth babe" David Bricker. I've known David a long time,and if you are there at the conference, tell him I sent you to visit him at the IBM booth.
David Bricker shows off some of the IBM System Storage product line at SNWin this YouTube video (2 minutes)
Sadly, I can't be in two places at once. SNW is a great conference to attend!
Technology Review has a great 6-minute video showing how the PowerTune system works in the ['self-tuning' guitar].
As with any self-tuning equipment, there are three essential parts.
Measurement. In the case of the guitar, small sensors identify the current note based on string tension.
Response. Based on the measurement, the self-tuning system either decides that there is no more to do, or to take specific action. In the case of this guitar, the action would be to loosen or tighten the string.
Action. The action taken that is expected to get closer to the desired result. In this case, tiny motorsinside the handle turn the thumbscrews to loosen or tighten the strings accordingly.
These are part of a "closed-loop design", as it is called in [Control Theory].After the action in step 3 is taken, goes back to step 1, takes a new measurement, and determines a new response. Thiscould mean that the string is tightened and loosened by ever smaller amounts until it is close enough to the desiredaccuracy, in this case an impressive two [cent].
On the server side, IBM has offered this for years. For example, for z/OS applications on System z mainframes, the[Workload Manager (WLM) offers a "goal mode"] that allows you to set desired results for your business applications, for example, how quickly they respond in processing transactions. WLM measures the response time of the transactions, determines anappropriate response if any, and takes action to shift processor cycles (MIPS) or RAM to help out the workloads with the highest priority, in some cases stealing cycles and RAM away from lesser priority tasks.
For storage, we have IBM TotalStorage Productivity Center. It can scan for file systems over 90 percent full, for example, determine an appropriate response based on policies, and take action to expand the file system to a larger size.This may involve dynamically expanding the LUN that the file system sits on, a feature available on IBM SAN VolumeController, DS8000 series, DS4000 series and N series disk systems.This is the kind of closed loop design that can help eliminate those pesky phone calls at 3am.
But why focus on just storage alone? Combining servers and storage into a higher-level closed loop design is accomplished with [IBM Tivoli Intelligent Orchestrator] and [IBM Tivoli Provisioning Manager]. In thiscombo, Orchestrator measures and responds, and can invoke Provisioning Manager workflows to take action. Workflows are like scripts on steroids. Unlike normal scripts which run on a single machine, workflows can communicate with multiple servers, storage and even networking gear to take the appropriate actions on each of those machines, like install updated software, carve a new LUN, or define a new SAN zone.
The products are well integrated with TotalStorage Productivity Center for the storage aspects.
This week, I am attending the [InterConnect Conference] in Las Vegas, Feb 21-25, 2016. This is IBM's premier Cloud & Mobile conference for the year.
Here is my recap of the lunch-time sessions Wednesday afternoon.
5663A Beyond Hyperconvergence to a Hyperscale Converged Infrastructure
Bernard "Bernie" Spang, IBM, presented. Organizations continue to face challenges with efficiently managing unprecedented volumes and varieties of data. Meanwhile, new frameworks such as Spark and Hadoop are emerging to efficiently exploit that data. These offerings have the potential to deliver significant benefits, but they can also increase data center complexity and cluster sprawl.
Bernie covered the evolution of Hyperconvergence to a Hyperscale converged technology. By extending software-defined infrastructure concepts to a converged application- and data-optimized fabric, IBM is enabling organizations to reduce costs and accelerate time to insight by efficiently storing, analyzing and protecting their data.
Hyperconvergence is the concept of running hypervisor software on storage-rich servers. Software-only versions include IBM Spectrum Accelerate and VMware VSAN, whereas pre-built systems are available from Nutanix, Simplivity and others.
But not everything is x86 or Hypervisor based. Some applications are better served on bare metal, while others might be better served on containers like Docker or LXC. IBM Spectrum Scale provides for all of these additional platforms, works on both x86 and POWER systems, and can handle storage tiering from flash to disk to tape. It can work across locations, representing any mix of on-premises and off-premises facilities.
1841A IBM Cloud Storage Options
I was pleased to have a standing-room only crowd attend my session!
The term "Cloud Storage" can be misleading. I spell out four unique types of storage:
Ephemeral Storage - storage that exists only as long as the Virtual Machine using it is running. This is ideal for boot volumes and temporary work space.
Persistent Storage - typically block/transactional/high-speed storage that continues to live beyond the life of the Virtual Machine.
Hosted Storage - files, documents and backup copies that are read/written in the Cloud
Reference Storage - files and objects that are written once, and never modified thereafter, such as archives, financial records, and photographs. Since the term Write-Once-Read-Many (WORM) applies only to tape and optical media, the IT Industry now uses Non-Erasable-Non-Rewriteable (NENR) to include flash and disk media protected in some manner through software to avoid tampering.
The first two I refer to as "Storage for the Computer Cloud" and the latter two I refer to as "Storage as the Storage Cloud".
I also discuss the differences between block, file and object access, and why different Cloud storage types use different access methods.
I wrapped up the session covering the various IBM storage solutions that we offer for all four Cloud Storage types.
IBM introduces the eight generation of Linear Tape Open (LTO) tape drive technology, with corresponding support in all of the IBM tape libraries.
Fellow blogger Jon Toigo, of Drunkendata.com fame, came to Tucson to interview Lee Jesionowski, Ed Childers, Calline Sanchez, and me about this. Check out the various segments on YouTube or his website.
The LTO-8 cartridges are not yet available, but when they are, they will hold 12 TB raw capacity, or 30 TB effective capacity at 2.5-to-1 compression ratio. The new drives are N-1 compatible to read/write LTO-7 cartridge media.
Previous generations also supported reading N-2 generation tapes, LTO-8 breaks from that tradition and will not support LTO-6 cartridges at all.
LTO-8 comes in both "Full Height" (FH) and Half-Height (HH) models. The FH models can transfer data at 360 MB/sec (or 900 MB/sec effective at 2.5-to-1 compression), and the HH models at 300 MB/sec (or 750 MB/sec effective at 2.5-to-1).
LTO-8 supports IBM Spectrum Archive and the "Linear Tape File System" (LTFS) tape format for self-describing long-term retention of data.
Compliance storage has come under many names. For tape and optical media, we had "WORM" for Write-Once, Read-Many. For disk-based storage, we had "Fixed-Content" or "Content-Addressable Storage". For file systems, we had "Immutable Storage".
Fortunately, the clever folks who crafted the SEC 17a-4 law came up with an umbrella term: "Non-Erasable, Non-Rewriteable" (NENR) that covers all storage media, from WORM tape and optical, to tamperproof flash, disk and cloud-based solutions.
The other major change is "Concentrated Dispersal" mode, or "CD mode" for short. Erasure Coding works best when data is dispersed across three or more sites. When this happens, you can lose all of the data at one site, and still have 100 percent access to all data from the other locations.
IBM's "Information Dispersal Algorithm", or IDA for short, scattered slices of data across many servers. Great for high availability and performance, but often meant that the minimum deployment was 500TB or greater.
Not every organization is ready for such a large purchase. Some want to just [dip their toe in the water] with something smaller, less expensive. Well IBM delivered!
The new CD mode means that instead of one slice per Slicestor node, you can pack lots of slices on each node. Each slice will be on distinct disk drives, for high availability.
Entry-level configurations now can be as little as 72-104 TB, across 1, 2 or 3 sites.
No post today. I will be joining the majority of IBMers in Tucson for "Days of Caring" held annually bythe [United Way of Tucson and Southern Arizona].IBM has been doing this for years, and we are joined by volunteers from other local businesses, including HealthNet, Wells Fargo bank, Texas Instruments, KVOA local NBC affiliate, 94.9 MixFM radio, and others.
The "days" involve a kick-off last week (Sep 19) and two days of helping local charities (Sep 24 and 27).We are split into teams and are assigned out to help fix up old buildings, clean out gutters, re-paintwalls. My team will be sorting canned goods at the local[Community Food Bank], and assembling boxes of items to begiven out to needy families.
Continuing this week's theme on products that were part of last week'sIBM Information Infrastructure launch, today I'll cover the TS2900.
IBM System Storage TS2900 Tape Autoloader
This little baby is SWEET! At 1U high, it holds a single drive and up to 9 cartridges,up to a total of 14.4 TB at 2:1 compression. Thedrive can be a Half-Height (HH) LTO-3 or LTO-4 drive. (It is called an autoloader because there isonly a single drive. Automation with multiple drives are called libraries).
This can be rack-mounted, or sit on your desktop. There is an I/O station for insertingor removing individual cartridges, as well as a removable tape magazine to populate orremove the tapes in a more efficient manner.
Both LTO3 and LTO4 support a mix of regular and "Write Once, Read Many" (WORM) media tohelp comply with regulations demanding "Non-erasable, Non-rewriteable" storage. TheLTO4 can also support on-drive encryption, managed by the IBM Encryption Key Manager (EKM).
To learn more, see the IBM System Storage[TS2900 page].
The comic combines the recent popularity in cookbooks to help parents get their children to eat morevegetables, such as Jessica Seinfeld's [Deceptively Delicious: Simple Secrets to Get Your Kids Eating Good Food], with the popularity of the latest Batman movie, [The Dark Knight]. To be fair, I have not reviewed the recipe book,but certainly being the wife of comedian Jerry Seinfeld and mother of his children sufficiently qualifies her to write such a book. I did have the pleasure to see this movie at an IMAX movie theater in Hartford, CT a few weeks ago. I highly recommend it. (See also my friend Pam's awesome [review of this movie]).Some have argued the movie franchise has "gone dark" from the previous Batman movies and may not be appropriatefor children. Hiding vegetables in meals may not the right thing for children either.
Unlike IBM that repeatedly delivers unique and innovative new products to the marketplace, Microsoft pulls theold ["bait and switch"] routine. In a series of hiddencamera interviews, Microsoft asks skeptical people who have never used Microsoft Vista operating system their opinions.As expected, all express concerns of problems they have heard about Microsoft's new OS, from friends, colleagues or Apple television advertisements. On a scale of 0 (won't touch it) to 10 (can't wait to have it), the averageskeptic rated Vista with a paltry 4.4 score.
The Microsoft interviewers then show them the new "Microsoft Mojave" Operating System, and askthese same skeptics for their opinions, of which many (35 out of 140 by one account) express they like it, find this new OS usefuland intuitive. The interviewers then explain that this Mojave OS was nothing more than the existing Vista OS alreadyin the marketplace. The average rating for Mojave OS was a significantly higher 8.5 score.Just like hiding spinach in a meal to get your kids to eat it. They tricked you, and you saidyou liked it!
Perhaps the key take-away is whom should prospective customers listen to when evaluating a new product. Microsoftis reasonable in feeling that customers should not base their opinions about Vista solely on lopsided Apple televisioncommercials. Apple, Inc. is one of Microsoft's primary competitors. I feel, however, that if you have friends or colleagues who have shared with you their hands-on experiences, that indeed should have much higher weighting.
Nothing, of course, beats personal experience. If you want to try out one of IBM's latest products for yourself, please contact your local IBM Business Partner or IBM sales representative.
This week I'm in Los Angeles for the Systems Technology Conference (STC '08).We have over 1900 IT professionals attending, of which 1200 IBMers from North America, Latin America,and Asia Pacific regions, as well as another 350 IBM Business Partners. The rest, including me, are world wideor from other areas.
Last January, IBM reorganized its team to be more client-focused. Instead of focused on products, we are nowclient-centric, and have teams to cover our large enterprise systems through direct sales force, business systemsfor sales through our channel business partners, and industry systems for specific areas like deep computing,digital surveillance and retail systems solutions.
In addition to 788 sessions to attend these next four days, we had a few main tent sessions.My third line (my boss' boss' boss) David Gelardi presented Enterprise Systems. This is the group I am in.
Akemi Watanabe presented for Business Systems. Her native language is Japanese, so to do an entire talk inEnglish was quite impressive. Her focus is on SMB accounts, those customers with less than 1000 employeesthat are looking for easy-to-use solutions. She mentioned IBM's new [Blue Business Platform] which includesLotus Foundation Start, an Application Integration Toolkit, and the Global Application Marketplace.
Part of this process is the merger of System p and System i into "POWER" systems, and then offering both midrangeand enterprise versions of these that run AIX, i5/OS and Linux on POWER. It turns out that only 9 percent of ourSystem i customers are only on this platform. Another 87 percent have Windows, so it makes sense to offer i5/OSon BladeCenter, to consolidate Windows servers from HP, Dell or Sun over to IBM.
Meanwhile, IBM's strategy to support Linux has proven successful. 25 percent of x86 servers now run Linux. IBMhas 600 full-time developers for Linux, over 500 of which contributed to the latest 2.6 kernel development. Our ["chiphopper"] program has successfullyported over 900 applications. There are now over 6500 applications that run on Linux applications, on our strategic alliances with Red Hat (RHEL) and Novell (SUSE) distributions of Linux.
Her recommendation to SMB reps: learn POWER systems, BladeCenter, and Linux. I agree!
Mary Coucher presented Industry systems. In addition to the game chips for the Sony Playstation, Nintendo Wii,and Microsoft Xbox-360, this segment focuses on Digital Video Surveillance (DVS), Retail Solutions, Healthcare and Life sciences (HCLS), OEM and embedded solutions, and Deep computing. She mentioned our recently announcediDataPlex solution.
IBM is focused on "real-world-aware" applications, which includes traffic, crime, surveillance, fraud, andRFID enablement. These are streams of data that happen real-time, that need to be dealt with now, not later.
Most people know that IBM has the majority of the top 500 supercomputers, but few may not realize that IBMalso has delivered solutions to the top 100 green companies. IBM success is explained in more detail in this[Press Release].
The group split up to four different platform meetings: Storage, Modular, Power, and Mainframe. Barry Rudolphpresented for the Storage platform. He talked about the explosion in information, business opportunities,risk and cost management. IBM has shifted from being product-focused, to the stack of servers and storage,to our latest focus on solutions across the infrastructure. He mentioned our DARPA win for [PERCS] which stands for productive,easy-to-use, reliable computing system.
This post will focus on Information Compliance, the fourth and final part of the four-part series this week.I have received a few queries on my choice of sequence for this series: Availability, Security, Retention andCompliance.
Why not have them in alphabetical order? IBM avoids alphabetizing in one language, because thenit may not be alphabetized when translated to other languages.
Why not have them in a sequence that spells outan easy to remember mnemonic, like "CARS"? Again, when translated to other languages, those mnemonics no longerwork.
Instead, I worked with our marketing team for a more appropriate sequence, based on psychology and the cognitive bias of [primacy and recency effects].
Here's another short 2-minute video, on Information Compliance
Full disclosure: I am not a lawyer. The following will delveinto areas related to government and industry regulations. Consultyour risk officer or legal counsel to make sure any IT solution is appropriatefor your country, your industry, or your specific situation.
IBM estimates there are over 20,000 regulations worldwide related to information storage and transmission.
For information availability, some industry regulations mandate a secondary copy a minimum distance away toprotect against regional disasters like hurricanes or tsunamis.IBM offers Metro Mirror (up to 300km) and Global Mirror (unlimited distance) disk mirroring to support theserequirements.
For information security, some regulations relate to privacy and prevention of unauthorized access. Twoprominent ones in the United States are:
Health Insurance Portability and Accountability Act (HIPAA) of 1996
HIPAA regulates health care providers, health plans, and health care clearinghouses in how they handle the privacy of patient's medical records. These regulations apply whether the information is on film, paper, or storedelectronically. Obviously, electronic medical records are easier to keep private. Here is an excerpt froman article from [WebMD]:
"There are very good ways to protect data electronically. Although it sounds scary, it makes data more protected than current paper records. For example, think about someone looking at your medical chart in the hospital. It has a record of all that is happening -- lab results, doctor consultations, nursing notes, orders, prescriptions, etc. Anybody who opens it for whatever reason can see all of this information. But if the chart is an electronic record, it's easy to limit access to any of that. So a physical therapist writing physical therapy notes can only see information related to physical therapy. There is an opportunity with electronic records to limit information to those who really need to see it. It could in many ways allow more privacy than current paper records."
GLBA regulates the handling of sensitive customer information by banks, securities firms, insurance companies, and other financial service providers. Financial companies use tape encryption to comply with GLBA when sending tapes from one firm to another. IBM was the first to deliver tape drive encryption withthe TS1120, and then later with LTO-4 and TS1130 tape drives.
For information retention, there are a lot of regulations that deal with how information is stored, in some casesimmutable to protect against unethical tampering, and when it can be discarded. Two prominent regulations inthe United States are:
U.S. Securities and Exchange Commission (SEC) 17a-4 of 1997
In the past, the IT industryused the acronym "WORM" which stands for the "Write Once, Read Many" nature of certain media, like CDs, DVDs,optical and tape cartridges. Unfortunately, WORM does not apply to disk-based solutions, so IBM adopted the languagefrom SEC 17a-4 that calls for storage that is "Non-Erasable, Non-Rewriteable" or NENR. This new umbrella term applies to disk-based solutions, as well as tape and optical WORM media.
SEC 17a-4 indicates that broker/dealers and exchange members must preserve all electronic communications relating to the business of their firmm a specific period of time. During this time, the information must not be erased or re-written.
Sarbanes-Oxley (SOX) Act of 2002
SOX was born in the wake of [Enron and other corporate scandals]. It protects the way that financial information is stored, maintained and presented to investors, as well as disciplines those who break its rules. It applies onlyto public companies, i.e. those that offer their securities (stock shares, bonds, liabilities) to be sold to the publicthrough a listing on a U.S. exchange, such as NASDAQ or NYSE.
SOX focuses on preventing CEOs and other executives from tampering the financial records.To meet compliance, companies are turning to the [IBM System Storage DR550] which providesNon-erasable, Non-rewriteable (NENR) storage for financial records. Unlike competitive products like EMC Centera thatfunction mostly as space-heaters on the data center floor once they filled up, the DR550 can be configured as a blended disk-and-tape storage system, so that the most recent, and most likely to be accessed data, remains on disk, but the older, least likely to be accessed data, is moved automatically to less expensive, more environment-friendly "green" tape media.
Did SOX hurt the United States' competitiveness? Critics feared that these new regulations would discourage newcompanies from going public. Earnst & Young found these fears did not come true, and published a study [U.S. Record IPO Activity from 2006 Continues in 2007]. In fact, the improved confidence that SOX has given investors has given rise to similarlegislation in other parts of the world: Euro-Sox for the European Union Investor Protection Act, and J-SOX Financial Instruments and Exchange Law for Japan.
For those who only read the first and last paragraphs of each post, here is my recap:Information Compliance is ensuring that information is protected against regional disasters, unauthorizedaccess, and unethical tampering, as required to meet industry and government regulations. Such regulationsoften apply if the information is stored on traditional paper or film media, but can often be handled more cost-effectively when stored electronically. Appropriate IT governance can help maintain investor confidence.
Next week, April 8-11, I will be presenting a variety of topics at the [Systems Technical University 2014] conference in Istanbul, Turkey. The conference will feature experts from IBM Power Systems, IBM System x, IBM PureSystems, and IBM System Storage.
Here are the titles and abstracts of the eight topics that I will be presenting next week, in chronological order, along with some related sessions for each topic:
IBM Smarter Storage Strategy
Do you want to understand more about IBM's initiatives for building a smarter planet and how that relates to the data economics of your organization? This session will explain it all, including how IBM's design approach and strategy for its various storage products and solutions for efficiency for data intensive solutions, optimization of business critical workloads, and agility to start quickly and add value. I will also position the features and capabilities of IBM's various disk and tape systems in this context.
Clod Barrera will present IBM Storage Strategy - Traditional and New Methods for Storage Deployment. My session is Tuesday morning and will focus on how IBM Storage Strategy is aligned with IBM's business initiatives including Cloud, Analytics, Mobile and Social Business (CAMS). Clod's presentation will be more technical in nature, featuring Flash storage, scale-out grids, object storage directions, and Software Defined Environments.
Axel Koester will present Storage Technology Futures - fresh from IBM research labs, tomorrow in your datacenter. Axel's presentation will focus on what IBM Research is working on, based on industry trends.
Pat O'Rourke will present Power Systems Trends and Direction, which will focus on IBM's strategy for the POWER Systems product line.
Replication for Business Continuity and Disaster Recovery (BC/DR)
Replication of disk storage systems can be used as part of an overall Business Continuity and Disaster Recovery plan. This session will provide an overview of the technologies involved, and other considerations.
Markus Oscheka and Ralf Wohlfarth will present IBM Storage Systems integration into VMware Site Recovery Manager, a more focused session that offers Business Continuity and Disaster Recovery for VMware environments.
Deniz Erguvan will present Disaster Recovery Solution Design with PowerVM and Storage Virtualization.
Thomas Vogel and Torsten Rothenwaldt will present Native IP replication with SVC / Storwize v7.2. This new feature was announced last October 2013.
Thomas Vogel and Torsten Rothenwaldt will also present New HA and DR concepts with SVC enhanced stretched cluster, focused on data federation across data centers.
What is big data? Architectures and Practical Use Cases
Do you understand the storage implications of big data analytics? This session will explain what big data is, and cover the Information Infrastructure and practical use cases.
Ajay Dholakia will present Taming Big Data: An overview of key technologies and architectures. Ajay will focus more on the hardware components (servers, networks, storage), whereas my presentation will focus on the roles of the storage administrator, data scientist and decision maker.
Axel Koester will present BIG DATA at CERN : Analyzing petabytes in seconds(!) at the European particle collider facility, a specific use case.
Jean-Armand Broyelle will present Big Data on Power: come and touch reality!, which will focus on the capabilities to process big data on POWER systems.
Cloud Storage and the Active Cloud Engine™
This session will cover private and public cloud storage options, including XIV, SONAS, Storwize V7000 Unified and Linear Tape File System (LTFS) Enterprise Edition. The use of Active Cloud Engine for local space management and global WAN caching to access files, SmartCloud Storage Access for self-service provisioning, and file-and-sync solutions will also be explained.
Eric Aquaronne and Jeff Borek will present Storage Cloud to energize your company. My session will focus on the technologies involved, whereas theirs will provide a product demo and practical implementation advice.
Mo McCullough will present XIV Overview and Update, Thomas Luther will present SONAS overview and Updates, and Nils Haustein will present Linear Tape File System Enterprise Edition (LTFS-EE) explained. These other topics will all go into more deep dive on each product solution than what I will cover in my high-level overview.
IBM Tivoli Storage Productivity Center
Why is Tivoli Storage Productivity Center (TPC) the #1 most requested topic at the IBM Tucson Executive Briefing Center? One of the chief architects of this product will cover the latest features, and why this product will greatly help your storage admin staff.
Clod Barrera will present Software Defined Storage - Storage for Software Defined Environments which will provide a broader view, while mine is focused specifically on how TPC plays a role in SDS.
Thomas Luther will present TPC for Replication 5.2 Overview and updates, will focus specifically on the Replication support in the latest release.
IBM Archive Storage Solutions - Data Retention for Government Compliance and Industry Regulations
This session will cover the various offerings IBM has for archive solutions, including IBM System Storage Archive Manager (SSAM), N series, and WORM tape storage systems.
Nils Haustein will present Next generation archive storage solutions which will focus specifically on SSAM software, with focus on migration procedures from other archive solutions.
New Generation of Storage Tiering: Less management, lower investment and increased performance
Confused on how to implement storage tiering between Flash, Disk, Tape storage system resources? This session will cover the various techniques and technologies available.
Levi Norman will present IBM FlashSystem Overview, focused on this particular tier of storage.
Axel Koester will present Storage Portfolio Selection Guide: What (not) to use when, providing an overview of the IBM System Storage portfolio, whereas I am focused more on the technologies that make up each tier of storage, and how to take advantage of them to balance cost and performance.
Data Footprint Reduction
Data Footprint Reduction is the catchall term for a variety of technologies designed to help reduce storage costs. This session will cover four techniques for data footprint reduction: thin provisioning, space-efficient snapshots, data deduplication and real-time compression. It will also discuss the IBM storage products that provide these capabilities. Come to this session to learn how these technologies work, and how they will benefit your data center.
bi Relation session:
Antoine Maille will present Demonstrate the TurboCompression Effect, a live demo of the technologies I will be discussing.
Johann Weiss will present The Storwize family - easy to manage, function rich and cloud ready, which will include a discussion of Real-time compression.
Mathias Defiebre and Erik Franz will present ProtecTIER with IBM FlashSystem (or maybe with Storwize). ProtecTIER is IBM's strategic data deduplication solution, which can act as a gateway in front of a variety of back-end storage options.
If you will be at this conference all week, look for me and say "Hello!"
The [IBM Edge2015 conference] is premiere conference covering Infrastructure Innovations for IBM System Storage, as well as sessions about z Systems and POWER Systems from our IBM Enterprise conference. Check out this short two-minute [YouTube video on IBM Edge2015].
Here is my quick recap of the sessions that I either presented myself, or presented by others that I found interesting, on Tuesday, May 12, 2015.
What Is Big Data? Architectures and Practical Use Cases
Not everyone understands the storage implications of Big Data analytics. I started this session explaining the basics of Big Data, and how it changes the entire information pipeline, from storage administrators to data scientists to empowered employees making decisions and taking actions.
I then gave some real-life use cases, from Vestas using Big Data to shorted a 3-week decision process down to 15 minutes, to University of Ontario using Big Data to save the lives of new-born babies.
I then provided a broad overview of IBM's Analytics platform, including IBM InfoSphere BigInsights, BigSQL and Platform Symphony. IBM is a major backer of the Open Data Platform to help provide standards-based choices in the analytics marketplace.
I wrapped up the session with IBM Spectrum Scale™ which has a Hadoop Connector which allows Map/Reduce programs to run unchanged against Spectrum Scale data. This eliminates the waste of ingesting data from other sources into an HDFS file system, then discarding the data after the analytics processing completes.
At past events, I normally present this on the first day, to provide context for all other presentations later in the week. However, this time, Ken Keverian presented IBM's Corporate strategy on the Tuesday keynote general session, so the event coordinators scheduled my session afterward. I was able to explain how IBM's Smarter Storage strategy fits hand-in-glove IBM's larger Corporate strategy.
As with all IBM strategies, there were three parts. First, IBM is helping clients deal with data growth, resulting from everything from the Internet of Things to Big Data analytics. IBM offers the market leading Real-time Compression capability, for example, to help reduce the amount of capacity consumed.
Second, IBM cannot forget its support of traditional "Systems of Record" applications, like ERP, SCM and CRM transactional workloads. IBM is helping clients deal with business pressures to balance performance versus cost across a variety of storage media, from the world's fastest non-volatile flash storage, IBM FlashSystem, to the least expensive options with tape.
Third, IBM strongly feels the IT industry is shifting to Cloud deployments, including private, public and hybrid clouds. IBM is helping clients with this transition, with support for Software Defined Environments from OpenStack, VMware and Microsoft. IBM ranks #1 in Software Defined Storage with over 40 percent marketshare.
Royal Caribbean Cruise Line's Success with IBM FlashSystem
This was a part IBM, part client testimonial session. Joe Rendace,
IBM Technical Flash Channel Manager, and Barry Whyte, fellow IBM Master Inventor and IBM ATS for Storage Virtualization, provided IBM's point of view on Flash technology. Last year, IBM shipped more Flash capacity than the next two closest competitors combined!
Jorge L. González, Enterprise SAN & Storage Architect for Royal Caribbean Cruise Line (RCCL) presented his company's success using IBM's FlashSystem products.
Archive Strategies in the Software-Defined Data Center
Jon Toigo, fellow author and blogger, Managing Principal Toigo Partners International and long-time friend presented this lively topic. Here is a great quote from his presentation:
"Moving data intelligently across different storage tiers (and into archives) is a lot like using a claw machine to get your crying kid a toy at the Chuck E. Cheese!
I can always rely on Jon to provide a unique viewpoint on the latest strategies and technologies. He never disappoints.
IBM Edge Special Events
For Tuesday evening, I went to see the world-famous [Penn & Teller] perform their unique form of magic and comedy show.
For the past 40 years, Penn & Teller have performed magic together, and watching them, up close and personal from just a few dozen feet away on stage, was truly amazing!
At IBM, our standard is to have a limit of 200MB per user mailbox. A few of us get exceptions and have up to500MB limit because of the work we do. By comparison, my personal Gmail account is now up to 6500MB. Whenthis limit is exceeded, you are unable to send out any mail until it is brought down below the limit, and a request to be "re-enabled for send" is approved, a situation we call "mail jail".
The biggest culprit are attachments. Only 10 percent of emails have attachments, but those that do take up 90percent of the total space! People attach a 15MB presentation or document, and copy the world ondistribution list. Everyone saves their notes with these attachments, and soon, the limits are blown. Not surprisingly, deduplication has been cited as a "killer app" to address email storage, exactly for this reason.If all the users have their mailboxes all stored on the same deduplication storage device, it might find theseduplicate blocks, and manage to reduce the space consumed.
A better practice would be to avoid this in the first place. Here are the techniques I use instead:
Point to the document in a database
We are heavy users of Lotus Notes databases. These can be encrypted and controlled with Access Control Lists (ACL)that determine who can create or read documents in each database. Annually, all the database ACLs are validatedso that people can confirm that they continue to have a need-to-know for the documents in each database. Sendinga confidential document as a "document link" to a database entry takes only a few bytes, and all the recipientsthat are already on the ACL have access to that document.
Point to the document on a web page
If the document is available on an internal or external website, just send the URL instead of attaching the file.Again, this takes only a few bytes. We have websites accessible only to all internal employees, websites thatcan be accessed only by a subset of employees with special permissions and credentials based on their job role, and websites that are accessible to our IBM Business Partners.
In my case, if I happen to have a blog posting that answers a question or helps illustrate an idea, I will sendthe "permalink" URL of that blog post in my email.
Point to the document on shared NAS file system
Internally, IBM uses a "Global Storage Architecture" (GSA) based on IBM's Scale-Out File Services [SoFS] with everyone getting initially 10GB of disk space to store files, with the option to request more if needed. The system has policy-based support for placing and migrating older data to tape to reduce actual disk usage, and combines a clustered file system with a global name space.
My SoFS space is now up to 25GB, and I store a lot of presentationsand whitepapers that are useful to others. A URL with "ftp://" or "http://" is all you need to point to a filein this manner, and greatly reduces the need for attachments. I can map my space as "Drive X:" on my Windows system,or as a NFS mount point on my Linux system, which allows me to easily drag files back and forth.
Departments that don't need to offer "worldwide access" use NAS boxes instead, such as the IBM System Storage N series.
Pointing to files in a shared space, rather than as attachments in email, may take some getting used to. I've hada few recipients send me requests such as "can you send that as an attachment (not a URL)" because they plan toread it on the airplane or train, where they won't have online connectivity.
"Have you invested in the latest and greatest in collaboration technology but still feel people are still not collaborating? How many Microsoft Sharepoint servers and IBM Quickplaces remain relatively untouched or only used by the organization's technorati? I think it's a big problem because this narrow view of collaboration starts to get the concept a bad name: "yeah, we did collaboration but no one used it." And then there the issue of the vast amount of money wasted and opportunities lost. We can't afford to loose faith in collaboration because the external environment is moving in a direction that mandates we collaborate. The problems we face now and into the future will only increase in complexity and it will require teams of people within and across organizations to solve them."
Well, sending pointers instead of attachments works for me, and has kept me out of "mail jail" for quite some timenow.
I helped set up the IBM booth at the Solutions Center, third floor, where we will have variousproducts on display, as well as subject matter experts to handle all the questions.
I also went ahead and got my conference badge. While most of my cohorts have purple badges, limiting them to the Solution Centers area, I have a red badge, so that I can attend the variouskeynote and break-out sessions this week.
In keeping with our "green" theme, we have all been given matching light green shirts, and these are 70 percent Bamboo cloth, and 30 percent cotton. They are very comfortable,and sustainable! If you see me, come up and just feel my shirt, go ahead, I won't mind!
Tomorrow, the fun begins with the keynote speakers!
This week, I have been presenting how to do important things without travel. Of course, there are times where you need some boots on the ground, while your support team remains remote.
Last month, fellow co-worker Liz Goodman reached out to me. She was part of a ten-person team that went to Tanzania as part of IBM's[Corporate Service Corps]. Other teams went to Brazil, China, Ghana, Romania, South Africa, The Philippines, Turkey and Vietnam.(I've been to half these other countries, but the closest I have ever been toTanzania was a safari I took in Kenya that included the Masai Mara national park which runsalong the border with Tanzania's Serengheti national park).
Liz was one of the lucky[200 candidates chosen among over 5000 applications] IBM reviews each year for this program. IBM does business in over170 countries, so learning to work in or with emerging growth markets requires a bit of "cultural intelligence".Liz and three others worked with the University of Dudoma [UDOM] to lead some students in adopting a [Moodle] infrastructure based on Linux, Apache, PHP and MySQL [LAMP] platform. She noticed that I had experience with both Moodle and LAMP from [my work with OLPC], and reached out to me for help.I was able to provide some insight, things to watch out for, and how to tackle not just the technical challenges, but a few that many don't consider:
Educational content. Digitizing materials already available in hardcopy, or obtaining digital rights to existing content.
Business Process. Getting the teachers and students to adopt new process and procedures enabled by these new capabilities.
Project Management. Fortunately, Liz is already [PMP-certified], and knows well the importance of managing even a small 4-person, 4-week project like this.
How well did her team do? Liz blogged before, during and after her trip. Read all about iton her blog [Liz Goes To Tanzania]!
I returned safely from my trip to Tulsa, Oklahoma.
(A special shout-out to Shannon at [In The Raw] sushi restaurant, and my new friends I met at the rooftop of [the Mayo]!)
Last week I was in Auckland, New Zealand teaching Top Gun class. Top Gun teaches IBM Business Partners and sales reps how to sell our products, services, and solutions. I have been teaching Top Gun classes around the world since 1998.
(Why didn't I post sooner? Because IBM's developerWorks was getting an exciting upgrade to IBM Connections 4.0, and bloggers like me have to wait for the conversion to complete!)
While many of my trips in the USA involve traveling alone, that is not the case for Top Gun classes. Our class manager, Joe Ebidia, brought his wife Karen. Our class administrator is Hyein (Hyein is a Korean name that rhymes with rain). In addition to some local instructors, I am joined by my IBM USA colleagues Scott McPeek (Tivoli Storage) and Vic Peltz (Disk/Replication/Competitive Sales).
The rest of the teach team arrived a day or two early to adjust to jet lag. I, on the other hand, got off the plane Monday at 6am, and had a business meeting that same morning with GTS architects from Wellington.
Clockwise from left: Karen is vegetarian, and had some pasta with tomato sauce. Hyein had a lamb burger. Joe had flounder. I had salmon risotto. Yum!
(To those asking why I have only the bellies of Karen and Joe in the picture, I was focused on taking picture of the food.)
After setting up the classroom, we took a ferry over to [Devonport], a charming seaside village just minutes across the bay from Auckland. The ferry boats were close the the Central Business District our [Stamford Plaza hotel] was in, and they run every 30 minutes.
The four of us walked up to the top of Mt. Victoria to see the views of the city. I highly recommend this! Once you get to Devonport, you can walk along the streets to see all the cute shops, or enjoy the parks and natural beauty. I had [done this before], but it is always worth doing again!
The class is four days long. I had six presentations. Here were the first three:
Selling IBM Storwize V7000 and V7000 Unified. Scott McPeek had already covered SAN Volume Controller (SVC), so it was easy to explain the Storwize V7000. For the V7000 Unified, I went into more detail of the file-based protocols and features, paving the way for Vic's "Selling SONAS" later in the week.
Selling IBM Storwize V3700. Having covered the SVC and Storwize V7000, my presentation on the Storwize V3700 focuses more on the positioning of when to sell which product for particular workloads.
Understanding IBM's Big Four Initiatives. This was an interesting request. I was asked to cover Social, Mobile, Analytics and Cloud (what we internally call SMAC) from a storage perspective. Social included Social Media, Social Networking and Social Business. Mobile focused on IBM's Mobile First campaign. Analytics included big data, Hadoop, and our various solutions for performing analytics. Cloud included IBM's Cloud Computing Reference Architecture (CCRA), IBM SmartCloud Enterprise storage, our Backup and Archive clouds, and the new SmartCloud Storage portfolio.
I will save the rest of the week for the next post!
My father's favorite question is "What's the worst that could happen?" He is retired now, but workedat the famous [Kitt Peak National Observatory] designing some of the largesttelescopes. Designing telescopes followed well-established mechanical engineering best practices, but each design was unique,so there was always a chance that the end result would not deliver the expected results. What's the worst that can happen? For telescopes, a few billion dollars are wasted and a few years are added to the schedule. Scrap it and start over. Nothing unrecoverable for the US government with unlimited resources and patience.
... the rest of the grimness on the front page today will matter a bit, though, if two men pursuing a lawsuit in federal court in Hawaii turn out to be right. They think a giant particle accelerator that will begin smashing protons together outside Geneva this summer might produce a black hole or something else that will spell the end of the Earth — and maybe the universe.
Scientists say that is very unlikely — though they have done some checking just to make sure.
The world’s physicists have spent 14 years and $8 billion (US dollars) building the Large Hadron Collider, in which the colliding protons will recreate energies and conditions last seen a trillionth of a second after the Big Bang. Researchers will sift the debris from these primordial recreations for clues to the nature of mass and new forces and symmetries of nature.
But Walter L. Wagner and Luis Sancho contend that scientists at the European Center for Nuclear Research, or CERN, have played down the chances that the collider could produce, among other horrors, a tiny black hole, which, they say, could eat the Earth. Or it could spit out something called a “strangelet” that would convert our planet to a shrunken dense dead lump of something called “strange matter.” Their suit also says CERN has failed to provide an environmental impact statement as required under the National Environmental Policy Act.
Although it sounds bizarre, the case touches on a serious issue that has bothered scholars and scientists in recent years — namely how to estimate the risk of new groundbreaking experiments and who gets to decide whether or not to go ahead.
What's the worst that can happen? Scientists now agree that it is sometimes difficult to predict, and someeffects may be unrecoverable.
Unfortunately, this is not the only example of people attempting things they may not understand well enough. Theweb comic below has someone complaining they are out of disk space, and the sales rep suggests solving this with a few commands which will result in deleting all her files. Hopefully, most people reading will recognize this is meant as humor, and not actually attempt the code fragments to "see what they do".
This is a webcomic called "Geek and Poke". If you dare to read the punchline, click here: Funny Geeks - Part 5.
Warning: Do not try the code fragments unless you know what to expect!
Sadly, I often encounter clients who have a "keep forever" approach to their production data. When they are seriously out of space, they feel forced to either buy more disk storage, or start "the big Purge": deleting rows from their database tables, emails older than 90 days, or some other drastic measures. With a focus on keeping down IT budgets, I fear that thesedrastic measures are growing more common. What's the worst that could happen? You might need that data for defending yourself against a lawsuit, or need it to continue to provide service to a loyal client, or just continue normal business operations.I have visited companies where a junior administrator chose the "big Purge" option, without a full understanding ofwhat they were doing, resulting in business disruption until the data could be recovered or re-entered.
IBM offers a better way. Data that may not be needed on disk forever could be moved to lower-cost tape, using up less energy and less floorspace in your data center. Solutions can automatically delete the data systematically based on chronological or event-based retention policies, with the option to keep some data longer in response to a "legal hold" request.
That's certainly better than to risk shrinking your business into a "dense dead lump"!
Last year, I covered Chris Anderson's book [The Long Tail]. This year, Chris Anderson, editor-in-chief of Wired.com, has an upcoming book titled Free, the past and future of a radical price. Chris talked about his book here at Nokia World 2007 conference, and the [46-minute video] is worth watching.He asks the big question "What if certain resources were free?" This could be electricity, bandwidth, or storage capacity. He explores how this changes the world, and createsopportunities for new business models. However, many people are stuck in a "scarcity" modeland treat nearly-free resources as expensive, and find themselves doing traditional things thatdon't work anymore. Chris mentions [Second Life] as aneconomy where many resources are free, and seeing how people respond to that.Rather than focusing on making money, new businesses are focused on gainingattention and building their reputation. Here are some example business models:
Cross-subsidy: give away the razors, sell the razor blades; or give away cell phones and sell minutes
Ad-Supported: magazines and newspapers sell for less than production costs
Freemium: 99% use the free version, but a handful pay extra for something more
Digital economics: give away digital music to promote concert tours
Free-sample marketing: give away samples to get word-of-mouth advertising
Gift economy: give people an opportunity and platform to contribute like Wikipedia
Nick Carr writes a post [Dominating the Cloud], indicatingthat IBM, Google, Microsoft, Yahoo and Amazon are the five computing giants to watch, as they are more efficient atconverting electricity into computing than anyone else. Last month, I mentioned IBM and Google partnership on cloud computing in my post[Innovationthat matters: cell phones and cloud computing].Nick's upcoming book titled[The Big Switch] looks into "Utility Computing",comparing the change of companies generating their own electricity to using an electric grid, to the recent developments of cloud computing and software as a service (SaaS). Amazon's latest "SimpleDB" online databaseis cited as an example.
Last, but not least, Seth Godin writes in his post [Meatballs and Permeability] about the bits-vs-atoms issue, what Chris Anderson above refers to as the new digital economy. The idea here is that value carried electronically as bits (digital documents, for example) have completely different economics than value carried as atoms (physical objects), andrequires new marketing techniques. Methods from traditional marketing will not be effective in this new age.Here is a [review] of Seth's new book Meatball Sundae: Is Your Marketing Out of Sync?
All three of these books seem to be covering the same phenomenon, just from different viewpoints. I lookforward to reading them.