There's some good discussion in the comments section over at Robin Harris' StorageMojo blog for hispost [Building a 1.8 Exabyte Data Center].To summarize, a student is working on a research archive and asked Robin Harris for his opinion. The archive will consist of 20-40 million files averaging 90 GB in size each, for a total of 1800 PB or 1.8 EB. By comparison, anIBM DS8300 with five frames tops out at 512TB, so it would take nearly 3600 of these to hold 1.8 EB. While this might seem like a ridiculous amount of data, I think the discussion is valid as our world is certainly headed in that direction.
IBM works with a lot of research firms, and the solution is to put most of this data on tape, with just enough disk for specific analysis. Robin mentions a configurion with Sun Fire 4540 disk systems (aka Thumper). Despite Sun Microsystems' recent [$1.7 Billion dollar quarterly loss], I think even the experts at Sun would recommend a blended disk-and-tape solution for this situation.
Take for example IBM's Scale Out File Services [SoFS] which today handles 2-3 billion files in a single global file system, so 20-40 million would present no problem. SoFS supports a mix of disk and tape, with built-in movement, so that files that were referenced would automatically be moved to disk when needed, and moved back to tape when no longer required, based on policies set by the administrator. Depending on the analysis, you may only need 1 PB or less of disk to perform the work, which can easily be accomplished with a handful of disk systems, such as IBM DS8300 or IBM XIV, for example.
The rest would be on tape. Let's consider using the IBM TS3500 with [S24 High Density] frames. A singleTS3500 tape library with fifteen of these HD frames could hold 45PB of data, assuming 3:1 compression on 1TB-size 3592 cartridges. You wouldneed 40 (forty) of these libraries to get to the full 1800 PB required, and these could hold even more as higher capacity cartridges are developed. IBM has customers with over 40 tape libraries today (not all with these HD frames, of course), but the dimensions and scale that IBM is capable lies within this scope.
(For LTO fans, fifteen S54 frames would hold 32PB of data, assuming 2:1 compression on 800GB-size LTO-4 cartridges.so you would need 57 libraries instead of 40 in the above example.)
This blended disk-and-tape approach would drastically reduce the floorspace and electricity requirements when compared against all-disk configurations discussed in the post.
People are rediscovering tape in a whole new light. ComputerWorld recently came out with an 11-page Technology Brief titled [The Business Value of Tape Storage],sponsored by Dell. (Note: While Dell is a competitor to IBM for some aspects of their business, they OEM their tape storage systems from IBM, so in that respect, I can refer to them as a technology partner.) Here are some excerpts from the ComputerWorld brief:
For IT managers, the question isnot whether to use tape, but whereand how to best use tape as part of acomprehensive, tiered storage architecture.In the modern storage architecture,tape plays a role not onlyin data backup, but also in long-termarchiving and compliance.
So, whether you are planning for an Exabyte-scale data center, or merely questioning the logic of a disk-for-everything storage approach, you might want to consider tape. It's "green" for the environment, and less expensive on your budget.
technorati tags: Robin Harris, StorageMojo, Exabyte, Data Center, IBM, blended, disk-and-tape, Sun, Huge Quarterly Loss, Thumper, SoFS, DS8300, XIV, N series, TS3500, S24, 3592, S54, LTO, LTO-4, ComputerWorld, Dell, Mike Karp, Greg Schulz[Read More]
Comments (4) Visits (8508)
Perhaps the recent financial meltdown is making storage vendors nervous.Both IBM and EMC gained market share in 3Q08, but EMC is acting strangelyat IBM's latest series of plays and announcements. Almost cont
No, I think EMC is afraid that companies will discover what they already know, that IBM has quality products that would stand a fair chance of side-by-side comparisons with their own offerings.We have enough fear, uncertainty and doubt from our current meltdown of the global financial markets, don't let EMC add any more.
Have a safe and fun Halloween! If you need to add some light to your otherwise dark surroundings, consider some of these ideas for [Jack-O-Lanterns]!
technorati tags: IBM, DS5300, ESG, benchmarks, SPC, SPC-1, SPC-2, SPC-3, VMware, VMmark, Oracle, Orion, Microsoft, JetStress, EMC, BarryB, RAID-X, RAID-5, DMX, CLARiiON, Celerra, XIV, financial, global markets, crisis, meltdown, Halloween, Jack-O-Lantern[Read More]
This is page 34 of Sequoia Capital's[56-slide presentation] about the current financial meltdown. In the past, IT spending tracked closely to the rest of the economy, but the latest downturn has not yet reflected in IT spend.
The rest of the deck is worth going through, with interesting stats presented in a clear manner.Read More]
Well, it's Tuesday again, and that means more IBM announcements!
I wish I could say this is it for the IBM announcements for October, given that this is the last Tuesday of the month, but there are three days left, so there might be just a few more!
technorati tags: IBM, SAN, Cisco, MDS9500, DCFM, BFM, EFCM, FCP, FICON, FCIP, iSCSI, Windows Vista, Windows 7, EMC, Centera, DR550, RAID-6, RAID-DP, RAID-X, NENR, FC, EXN4000, SAS, N3300, N3600, A-SIS, Disk Sanitization, FlexScale, PAM, DS5000, Netware, Solaris, DS3000, DS4000, DS8000, SVC, XIV, RFID, 3589, 3599, LTO, 3592, tape, cartridges, VOLSER[Read More]
In collaboration with [The Feminist Press] and the[National Science Foundation], IBM launched today a new Web site called ["Under the Microscope"]to encourage young women to pursue education and careers in science, technology, engineering and math (STEM).
The site is filled with information. One item I found particularly interesting was Science Debate 2008's[14 Questions about Science] where the top two U.S. presidential candidates answer questions about science. Barack Obama's answers inDemocratic blue, and John McCain's answers in Republican red.
This is just one of the ways IBM is trying to reach out and help our next generation.Read More]
For a while now, IBM has been trying to explain to clients that focusingon just storage hardware acquisition costs is not enough. You need toconsider the "Total Cost of Ownership" or TCO of a purchase decision.For active data, a 3-5 year TCO assessment can give you a better comparison of costs between IBM and competitive choices. For long-term archive retention, 7-10 year TCO assessment may be necessary.
This is part of a video series called [Don't Hide from the Truth].
Enjoy the weekend!Read More]
Nicole Carrier over at IBM Lotus team has [posted a clever video]explaining enterprise mashups to promote IBM's work in this area.
While some might be familiar with mashups that combine public Web 2.0 sources of information, enterprise mashups go one step further, integrating withthe "information infrastructure" of your data center. It's not just enough to deliver theright information to the right person at the right time, it has to bein the right format, in a manner that can be readily understood andacted upon. Enterprise mashups can help.
Ready to start? Check out the[IBM Mashup Center eKit].Read More]
Comment (1) Visits (6635)
Last month, HP and Oracle jointly announced their new "Exadata Storage Server".This solution involves HP server and storage paired up with Oracle software, designed for Data Warehouse andBusiness Intelligence workloads (DW/BI).
I immediately recognized the Exadata Storage Server as a "me too" product, copying the idea from IBM's [InfoSphere Balanced Warehouse]which combines IBM servers, IBM storage and IBM's DB2 database software to accomplish this, but from a singlevendor, rather than a collaboration of two vendors.The Balanced Warehouse has been around for a while. I even blogged about this last year, in my post[IBMCombo trounces HP and Sun] when IBM announced its latest E7100 model. IBM offers three different sizes: C-class for smaller SMB workloads, D-class for moderate size workloads, and E-class for large enterprise workloads.
One would think that since IBM and Oracle are the top two database software vendors, and IBM and HP are the toptwo storage hardware vendors, that IBM would be upset or nervous on this announcement. We're not. I would gladlyrecommend comparing IBM offerings with anything HP and Oracle have to offer. And with IBM's acquisition of Cognos,IBM has made a bold statement that it is serious about competing in the DW/BI market space.
But apparently, it struck a nerve over at EMC.
Fellow blogger Chuck Hollis from EMC went on the attack, and Oracle blogger Kevin Closson went on the defensive.For those readers who do not follow either, here is the latest chain of events:
When it comes to blog fights like these, there are no clear winners or losers, but hopefully, if done respectfully,can benefit everyone involved, giving readers insight to the products as well as the company cultures that produce them.Let's see how each side fared:
Chuck implies that HP doesn't understand databases and Oracle doesn't understand server and storage hardware, socobbling together a solution based on this two-vendor collaboration doesn't make sense to him. The few I know who work at HP and Oracle are smart people, so I suspect this is more a claim againsteach company's "core strengths". Few would associate HP with database knowledge, or Oracle with hardware expertise,so I give Chuck a point on this one.
Of course, Chuck doesn't have deep, inside knowledge of this new offering, nor do I for that matter, and Kevin is patient enough to correct all of Chuck's mistaken assumptions and assertions. Kevin understands that EMC's "core strengths" isn't in servers or databases, so he explains things in simple enough terms that EMC employees can understand, so I give Kevin a point on this one.
So, what does Chuck propose as the preferred alternative: a three-way collaboration! EMC's counter-proposal is to cobble together [Dell servers, EMC storage, and Oracle software].
If two is bad, then three is worse! How much bubble gum and bailing wire do you need in your data center? The better option is to go to the one company that offers it all and brings it together into a single solution: IBM InfoSphere Balanced Warehouse.Read More]
Comments (2) Visits (11679)
Well, it's Tuesday again, and that means more announcements from IBM!
In conjunction with IBM's new [System z10 Business Class (BC)] mainframe designed for Small and Medium-sized Businesses (SMB), IBM also announced related storage prod Yes, it's alive! Contrary to the FUD you might have read from our competitors, IBM continues to sell thousands and thousands of IBM System Storage DS6800 disk systems, and now enhances them with the optionfor 450GB 15K RPM drives. What is nice about these 450GB drives is that they are as fast or faster* than 300GBdrives, so the typical trade-off between performance and capacity do not apply. This may or may not result in application performance improvements, depending on workload pattern. Your mileage may vary.) Understanding that clients want complete solutions from single vendors, IBM offers synergy between System z and the IBM System Storage DS8000 disk systems. The latest R4.1 microcode upgrade offers two key features onthe various models [2107, In the past, if the disk system in site A failed, you would switch over to site B, which would have to resend send all the data again to site C to be resynchronized. This is because site B was not tracking what the System Data Mover (SDM) reader had or had not yet processed. With DS8000 4.1, the "incremental resync" function that, along with using IBM HyperSwap, requires site B to only send and resync the data that was in-flight when the outage occurred. When you compare the difference in sending this limited amount of in-flight data with the traditional complete volume of data, you can see how "Incremental Resync" can resynchronize the data 95% faster, and also greatly decrease your bandwidth requirements. This reduces the risk in case a subsequent outage occurs. Introduced originally in 1997 as the IBM Virtual Tape Server (VTS), the [IBMSystem Storage TS7700] series supports Grid capabilityto replicate tape image data across locations. Here's a quick recap of today's announcement: While our competitors might be boarding up their windows in preparation for the economic downturn in the USAeconomy, IBM remains generating solid results. San Jose Mercury News has an article that discusses this titled[IBM's 3Q profit strong on global sales].There has never been a better time to buy from, or invest in, IBM! technorati tags: IBM, z10 BC, mainframe, SMB, DS6000, DS6800, 450GB, 15K, RPM, FUD, DS8100, DS8300, DS8000, zHPF, FICON, Incremental Resync, z/OS, MGM, HyperSwap, VTS, TS7700, TS7740, TS7720, tape-less, IRMM, TS1130, encryption, Mercury News, 3Q08, profit
Yes, it's alive! Contrary to the FUD you might have read from our competitors, IBM continues to sell thousands and thousands of IBM System Storage DS6800 disk systems, and now enhances them with the optionfor 450GB 15K RPM drives. What is nice about these 450GB drives is that they are as fast or faster* than 300GBdrives, so the typical trade-off between performance and capacity do not apply.
This may or may not result in application performance improvements, depending on workload pattern. Your mileage may vary.)
Understanding that clients want complete solutions from single vendors, IBM offers synergy between System z and the IBM System Storage DS8000 disk systems. The latest R4.1 microcode upgrade offers two key features onthe various models [2107,
In the past, if the disk system in site A failed, you would switch over to site B, which would have to resend send all the data again to site C to be resynchronized. This is because site B was not tracking what the System Data Mover (SDM) reader had or had not yet processed.
With DS8000 4.1, the "incremental resync" function that, along with using IBM HyperSwap, requires site B to only send and resync the data that was in-flight when the outage occurred. When you compare the difference in sending this limited amount of in-flight data with the traditional complete volume of data, you can see how "Incremental Resync" can resynchronize the data 95% faster, and also greatly decrease your bandwidth requirements. This reduces the risk in case a subsequent outage occurs.
Introduced originally in 1997 as the IBM Virtual Tape Server (VTS), the [IBMSystem Storage TS7700] series supports Grid capabilityto replicate tape image data across locations. Here's a quick recap of today's announcement:
While our competitors might be boarding up their windows in preparation for the economic downturn in the USAeconomy, IBM remains generating solid results. San Jose Mercury News has an article that discusses this titled[IBM's 3Q profit strong on global sales].There has never been a better time to buy from, or invest in, IBM!
technorati tags: IBM, z10 BC, mainframe, SMB, DS6000, DS6800, 450GB, 15K, RPM, FUD, DS8100, DS8300, DS8000, zHPF, FICON, Incremental Resync, z/OS, MGM, HyperSwap, VTS, TS7700, TS7740, TS7720, tape-less, IRMM, TS1130, encryption, Mercury News, 3Q08, profit[Read More]
Over at The Register, Chris Mellor has an article titled[The IBM DS5000: Best in a field of one], discussing how the IBM System Storage DS5300 is in a class by itself.
IBM hired independent analyst Enterprise Strategy Group[ESG] to validate the box, and run workload-specific benchmarks. I agreewith Chris, the results are impressive! The report includes results from Microsoft Exchange JetStresstool to provide insight into email performance, and another benchmark to simulate Web server IOPS.
Also, the published SPC-1 benchmark for the DS5300 puts it at about 29 percent improvement over the DS4800.Chris argues the DS5300 is similar in class to NetApp FAS3170, which IBM sells as the IBM System Storage N6070.
If you are interesting in either the DS5300 or N6070, contact your local IBM Business Partner or sales rep.
Comment (1) Visits (5283)
Continuing this week's theme on dealing with the global economic meltdown, recession and financial crisis, I found a great video that recaps IBM CEO Sam Palmisano's recommendations to being more competitive in thisenvironment.
To learn more, here is the companion [PDF document].Read More]
Comment (1) Visits (8893)
Lakota Industries made news with the introduction of its [Sarah-Cuda Hunting Bow], named after moose-huntingU.S. Vice President nominee and Governor of Alaska [Sarah Palin]. This has all the same features as their other high-end hunting bows, but is lighter, smaller and available in Pink Camo. This "pin
Not to be outdone, today, at the Storage Networking World Conference, IBM announced the new IBM System Storage SAN Volume Controller Entry Edition [SVC EE].
You might be thinking: "Wait! IBM SVC is already the leading storage virtualization product among SMB clients today,why introduce a less expensive model?" With the global economy in the tank, IBM thought it would be nice to help outour smaller SMB clients with this new option.
This new offering is actually a combination of new software (SVC 4.3.1) and new hardware (2145-8A4). Here are thekey differences:
The SVC EE is not a "dumbed-down" version of the SVC Classic. It has all the features and functions of theSVC Classic, including thin provisioning with "Space-efficient volumes", Quality of Service (QoS) performance prioritization for more important applications, point-in-time FlashCopy, and both synchronous and asynchronous disk mirroring (Metro and Global Mirror).
While IBM has not yet have SPC-1 benchmarks published, IBM is positioning the SVC EE as roughly 60 percent of the performance, at 60 percent of the list price, compared to a comparable SVC Classic 2145-8G4 configuration. The SVC Classic is already one of the fastest disk systems in the industry. By comparison, the SVC EE is twice as fast as the original SVC 2145-4F2 introduced five years ago.If you outgrow the SVC EE, no problem! The 2145-8A4 can be used in traditional SVC Classic mode, and the SVC EE software can be converted into the SVC Classic software license for upgrade purposes, protecting your originalinvestment!
For those considering an HP EVA 4400 or EMC CX-4 disk system, you might want to look at combining an SVC EE with [IBM System Storage DS3400] disk. The combination offers more features and capabilities, and helps reduce your IT costs at the same time.
And if you are worried you can't afford it right now, IBM Global Financing is offering a ["Why Wait?" world-wide deferral of interest and payments] for 90 days, so you don't have to make your first payment until 2009, applicable to all IBM System Storage products, including the SVC EE, SVC Classic and DS3400 disk systems.
You can read more details on fellow blogger Barry Whyte's[Storage Virtualization] blog.
technorati tags: IBM, SVC, SVC EE, SVC Classic, Lakota Industries, Sarah-Cuda, Sarah Palin, Flamingo Pink, Raven Black, RPQ, SPC-1, 2145-8A4, DS4300, IBM Global Financing, Why Wait, FlashCopy, Metro Mirror, Global Mirorr, Barry Whyte[Read More]
Well, it's Tuesday, and more IBM announcements were made today. Many of my colleagues are in Dallas, Texas for the[Storage Networking World conference], and hopefully I will get some feedback from them before the week is over.
Today, IBM made announcements for Storage Area Networking (SAN) gear and disk systems.
So whether your data center is filled with System z mainframes, or other open systems, IBM has a solution for you.
technorati tags: IBM, SNW, SAN, disk, storage, system, Shortwave, Longwave, SFP, transceiver, SAN256B, SAN768B, directors, SAN18B-R, SAN04B-R, routers, SAN24B-4, Express, SAN40B-4, SAN80B-4, switches, FICON Accelerator, Brocade, McDATA, Fibre Channel, FC, FCP, FICON, z/OS, XRC, channel extender, DS3000, DS3300, DS3400, Ethernet, iSCSI, SAS, RAID-6, Linux on POWER, Solaris, IBM i, i5/OS, VIOS, DCS9900, DCS9550, HPC[Read More]
Comment (1) Visits (6546)
As the popular idiom goes, ["Every cloud has a silver lining"], and perhaps there are some things that we gain from the recent financial collapse of the global world markets.
Let's examine some of these:
For more on the impact of the financial meltdown on IT, see this InfoWorld[Special Report].
technorati tags: IBM, cloud, silver lining, financial, collapse, crisis, meltdown, global, world, markets, consolidation, XIV, DS8000, SoFS, TS3500, performance, energy efficiency, SMI-S, WBEM, ITIL, TotalStorage Productivity Center, SRM, InfoWorld[Read More]
Today, IBM announced its latest [BladeCenter S] with integratedredundant SAN fabric and disk storage inside the chassis. The tag line is "Data Center Capability, without the Data Center!"
I've gotten a few calls on this today, so I thought it would be good to blog about. To understand what is new,you need to understand what we had in other BladeCenter chassis. In those other chassis, there were up to 14 bladeservers on the front, and switch modules for FCP and Ethernet on the back. The entire chassis was rack-mountedto be connected to external devices.
Here's what you can get with the BladeCenter S:
The blades use either Intel, AMD or POWER processors, so you can run Windows, Linux, AIX, and [IBM i] (the newname for i5/OS V6R1).
Back 20 years ago, I worked with people with System/36 and System/38 systems. They loved it. Everything inone package. This grew into the AS/400 server. Having everything in one package was such an advantage thatIBM extended this to include a few "x86 blades" to run Windows applications but share the storage and networkresources.
Now IBM has taken this one step further. The older models assumed the majority of applications run underIBM's OS/400 or i5/OS operating system, but this new BladeCenter S does not make that assumption. You canmix and match different blade servers as needed, and run the operating systems you need.
This is an ideal packaging for Small and Medium sized Business (SMB), remote branch offices, and retail stores.In fact, more than 4,000 retail stores plan to run their operations using BladeCenter S this holiday season! For moreon this announcement, see the [IBM Press Release].