Storwize V7000 and the IBM NAS software were married Wednesday, October 12, 2012 at midnight at IBM Storage chapel in San Jose, California. The Reverend Rod Adkins officiated. Following the ceremony, the bride’s parents hosted a reception at the Almaden Research Center.
The bride comes from the NAS family who were in attendance. She also has ties with the Tivoli and GPFS families deep within the storage community. There were family members from the X series family who were at the ceremony.
The groom comes from a long line of storage products. XiV, DS8800 and SVC were all part of the festivities and supported the groom throughout entire day.
The couple will honeymoon Redwood City, California with a visit to the Storage Performance Council.
After long anticipation, IBM is now in the unified storage market with the introduction of the Storwize V7000 Unified (SV7kU?). The system stands as small as 6U of rack space and can flex up to four clustered systems (via RPQ) supporting internal SAS, SATA or virtualized external disk from other vendors.
The V7000 Unified is a midrange disk system that will allow new V7000 or existing V7000 customers the ability to integrate their NAS workload into the system. Using the standard V7000 shelf, IBM has added two 3650m3 servers with the IBM NAS software stack to complete a unified architecture. A new GUI that ingrates the NAS portion of the software is now available that will combine management for both technologies with a few mouse clicks. Setup of the system stays the same with the simplified USB key approach. Customers have reported that between the USB key installation and the wizard driven alerts, the V7000 has been one of the easiest systems to install and configure. IBM decided to keep these features in the enhanced GUI.
Here are some screenshots that show the new integration of the NAS software stack
V7000 Unified will support NFS/CIFS/FTP/HTTPs/SCP protocols in addition to block functions FCP and iSCSI. It will also support file replication and file level snapshots for business continuity in addition to existing block functions.
Another function in the V7000 Unified that will help customers is the introduction of the IBM Active Cloud Engine. What is it? Think of it as a very smart, very fast robot – that never sleeps – keeping your cloud storage neat, tidy and running smoothly. Think Rosie the robot from The Jetsons.
This engine is a policy driven engine that will help improve the storage efficiency by automatically placing, moving and deleting files to the appropriate storage. The efficiency gain comes from storing the files where they should be with out an administrator manually moving them. As data is gets older, the engine can move the file to another location where the price per TB is less and even delete the file if necessary.
The movement is done seamlessly and the end user does not have any idea their data has moved. Another aspect of the engine is identifying files for backups or replication to a DR location. As the data ages, the data continues the life cycle through the data center without storage administrators intervention.
Data can be moved from internal disk to external virtualized disk and even to tape. The diagram below shows the movement from file creation to 180 days old and off to deduped tape.
The policy can be created from a wizard in the V7000 Unified GUI by creating thresholds and start times. Customers can also exclude certain files by different file attributes like size or last accessed. For the more advanced customer, an edit feature of the policy is allowed.
Another question people are asking is about the relationship with Netapp and how will this product effect the N series product line. IBM is expanding the midrange storage portfolio by offering both the new V7000 Unified along with our N series products to focus on different client needs.
N series continues to be IBM’s offering focused on clients who have a primary need for NAS optimized (file) workloads. Existing N series clients with growing data requirements will continue to require additional N series disk drives, expansion units, and new systems to meet their needs.
IBM Storwize V7000 Unified will particularly appeal to clients who have a primary need for storage to support block optimized workloads with additional needs to consolidate file workloads for greater efficiency (unified storage). Storwize V7000 Unified is also targeted to clients that can benefit from the unique capabilities of IBM Active Cloud Engine or to clients that already are using Storwize V7000 or SONAS.
Just like in real life, we have seen other marriages come and go but this one seems to be different. The V7000 Unified is using the best of the storage portfolio and bringing value to the customer. IBM is also leveraging the investments made over 10 years of innovation; Virtualization, Easy Tier, Simplified GUI, Active Cloud Engine and is producing a product that will accomplish the lowering total cost of ownership.
As goes with the tradition of the bride to have good-luck: “Something old, something new, something borrowed, something blue, and a silver sixpence in her shoe." (You can find this poem in Leslie Jones' book "Happy is the Bride the Sun Shines On."). We find the IBM version of this offering good luck with the following: Something Old: 4,500 V7000 systems sold last year Something New: Active Cloud Engine Something Borrowed: Storage Virtualization Something Blue: Storwize V7000 Unified, a true IBM organic product
I am still looking for the sixpence but feel free to mail us one and we will attach it to the bezel of each controller.
I just read the blogs from Chris Mellor from the Register
and Tom Trainer Network Computing and thought how insightful are these two
outsiders about the inner workings of IBM.
First off, yes IBM is no longer selling the DCS9900, a DDN
OEM rebranded system in the very large IBM storage portfolio. There is no question that this product is no
longer available after the October 15 date.
Second, the DCS 3700 is already part of our portfolio and is
now an OEM box from Netapp/Engenio/LSI. The density of this system is the same as the
DCS 9900 and makes sense to use the DCS 3700 as a replacement for the DCS9900.
Third, Tom’s blog about SONAS being a monolithic NAS storage
is very skewed. SONAS is a very flexible
in the way we can scale both storage and the throughput with out affecting either
variable. Most “scale out” systems you
have to scale both in order to keep up with demand. SONAS uses some of the best technology on the
market with a huge amount of throughput.
His statement about IBM dropping DDN from SONAS is un-true
and goes to show how much research Tom put into writing this blog. I am sure Tom is looking out to write a
non-biased blog for Network Computing but maybe those days at HDS are still
making a big influence in his ability to look at announcement letter and make a
extrapolations about other products.
Finally, If HDS thought BlueArc was so great, why didn’t they
buy them back when they could have gotten the company for a better deal? Has the product changed THAT much since
2006?I wish HDS only the best for
dealing with the transition and getting that product under the HDS umbrella.
If you do your homework and base your assumptions on facts
instead of conjecture, you will find SONAS is a solid platform in the enterprise
NAS market.SONAS has proven it can be
the market leader with a low cost to performance ratio and will only get better
as time goes on.
Every year IBM puts on a conference for all of our clients, business partners and strategic partners.
This conference has both Storage and X series sessions along with key note speakers from the top management at IBM.
People come from all over the world to this conference looking for the
'how to' answers and whats to come with the product lines. There is also a solution center that houses all of the products along with our sponsors. This year our top platinum sponsors are Cisco, Intel and Netapp. Other sponsors include Brocade, Emulex, Fuision-IO, VMWare, Red Hat and SUSE.
I plan to be working in the solution center at the SONAS booth talking
to clients about the benefits of SONAS and how it fits into their
environments. If you are wanting to stop by here are the hours that I will be there:
Monday, July 18th Solution Center Open 5:30 PM – 7:30 PM ( w/Networking Drinks) Tuesday, July 19th Sponsor / Exhibitor Only Lunch 11:15 AM – 11:45 AM Solution Center Open 11:45 AM – 1:00 PM (Coffee & Dessert served in the Solution Center) Solution Center Open 5:30 PM – 7:30 PM ( w/Networking Drinks) Wednesday, July 20th Sponsor / Exhibitor Only Lunch 11:15 AM – 11:45 AM Solution Center Open 11:45 AM – 1:00 PM (Coffee & Dessert served in the Solution Center)
I also will be presenting a few sessions on NAS technology here at the conference. Most of my sessions will be a look at what IBM is doing with SONAS, N series and Real Time Compression.
I have a NAS 101 class that I really love doing because there are so
many people that have a misconception of what NAS is today. In my N
series update session we will be talking about the latest release on
N6270 and the EXP 3500 as well as a peek at the R23 release coming in a
few weeks. The other two sessions I am doing are a little off the topic of NAS but around social media and using www.ibm.com for help.
Tony Pearson, John Sing and Ian Wright will be joining me on a panel to
discuss the roles we play in social media and what each of us thinks of
the future of social media. The support session is something that
a client suggested to me out of their frustration of how to find
documents on our support pages. Here is a list of sessions and times that I will be presenting:
7/18 - 1:00 sSN14 Storage Networking (NAS - SAN) NAS 101: An Introduction to Network Attached Storage 7/19 - 10:30 sSN15 Storage Networking (NAS - SAN) NAS @ IBM 7/19 - 1:00 sSN18 Storage Networking (NAS - SAN) IBM N series: What's New? 7/20 - 1:00 sGE10 General Tips and Tricks on Searching for Support Answers on ibm.com 7/20 - 5:30 sGE61 General Using Social Media in System Storage 7/21 - 10:30 sSN18 Storage Networking (NAS - SAN) IBM N series: What's New?
7/21 - 2:30 sSN15 Storage Networking (NAS - SAN) NAS @ IBM
you are at the conference feel free to come to any of my sessions and I
would love to hear from you about the IBMNAS blog or any of my social
media outlets. We are using the following hashtag for the
conference all week if you want to follow what is going on via twitter
May 9th has been a target on my calendar for some
time now. Inside of IBM, we have been
waiting for this day to come so we could talk about the new things being
released in the storage platform. It
almost feels like Christmas morning with a bunch of new presents under the
tree. Each gift has inside something
that is either really cool or something very useful.The only difference is your Aunt Matilda and
her little dog is not coming over for brunch.
Under the IBM tree today is a slew of presents for almost the
entire storage platform. I will
concentrate on just the IBM NAS ones but if you are interested in knowing what
is going on elsewhere, you can find more information at the main website.
SONAS must have been a good boy because there are plenty of
gifts for him under the tree this morning. Not only did he find presents under the tree
but there were a few little things in his stocking. Here is what Santa brought:
hardware update on the X3650 nodes. Just like before, the SONAS system uses
the impressive workhorse but now it uses the more powerful M3 class with a
six core Xeon Intel 2.66GHz processor. It has 24GB of DDR3 RAM with the option
to increase to a total of 144 GB of DDR3 RAM per interface node. Also new with the X3650 is the option to
include a second processor to double the amount of cores to 12 total per
under the tree is new support for not only XiV but now SONAS supports the
SVC and V7000 as disk subsystems. This
is a huge gift because now SONAS can support tons of other storage under
the awesome virtualization of the SVC code. V7000 support is also interesting as that
platform has the virtualization code from SVC but also support its own
drive architecture including solid state drives.
same category of sweaters, SONAS gets a little smaller rack extender.In the past IBM has used a 16 inch
extender in order to accommodate the large 60 drive disk enclosure.That
has now been trimmed down to only 8 inches and 0 for the gateway model and
RXC rack that houses only interface nodes.
gets a new file system upgrade to GPFS 3.4 PTF4. This will provide a significant performance
improvement over the R1.1.1x release. The updated file system handles small
file and random I/O a lot more efficiently. With this update we now use the role of
manager nodes instead of interface nodes to gain more flexibility in how
we track data in cache.
gifts SONAS received were new support for NDMP, Anti-virus support, use of
both 10GbE ports on the same CNA and some power updates for the EU countries.
And along with all of that, there
is a new performance monitoring package called Perfcol that collects more
information for analysis.
This SONAS release is labeled R1.2 and can be obtained by
contacting the technical advisor assigned to you.
Santa was also at the N series house and dropped off a few
gifts.A new N6270 to replace the
N6070.This new system is in line with
the N6200 series with larger amounts of RAM and processors.Just like the smaller N6240, there is an
expansion controller where customers can add more PCI control cards like HBAs,
10GbE or even FCoE.A new disk shelf was
also released which uses the smaller 2.5 inch drives with improved back end
And over at the Real Time Compression house they got new
support for EMC Celerra.
Over all a very busy time of year for IBM (and Santa) as
these were just a fraction of the Storage announcements today.Also today is the IBM Storage Executive
Summit in New York City.My friend and
fellow blogger Tony Pearson is covering this great event and will be updating
his blog and twitter feed.If you were
not able to make it to NYC for the event, feel free to tweet him your questions
@az990tonyYou can also send questions
to our IBM Storage feed at @ibmstorage
I had the pleasure to present at the IBM Technical conference (aka STG-U) this past week. I was asked to speak about NAS technology basics and how the world is moving to more and more NAS platforms. Typically I get to present on some type of product, SONAS, NSeries, and the like. This was very much different as I got the chance to go deeper into the technology with out talking too much about products. The session name I used was NAS 101: An Introduction into NAS technology. The idea was to help educate our technical teams about the history of NAS, how NAS works, some pitfalls and then NAS at IBM.
There is so much surrounding NAS and to boil all of that down to a 1 hr 15min presentation is pretty difficult. The other challenge is trying to keep the information relative to the amount of knowledge everyone has in the session. I had people who were very skilled storage engineers to people who just getting into the business. I hope the information I presented was relative at all levels.
wanted to post my slide deck here so if you have a need or want me to
come and help teach what NAS is all about feel free to contact me.
How does one judge a glass of wine? There are a few tests, how it looks, smells and taste are the basic three. But as the wine is poured you may or may not know that your wine is made up of different varieties of grapes. A producer sits down and experiments with different percentages of grapes and this allows some creativity in making a better glass of wine for the consumer. Of course there are many more factors that play into this process but its by in large the same no matter what wine you enjoy. You enjoy the wine as a whole, a combination of things put together for you with out you having to know or even understand all that went into making that glass of wine.
When we talk to clients about their data backup strategy, we find a very similar process to that of wine making. The end user rarely knows all that goes in to creating a backup of their data and protecting it for them. They just enjoy the knowledge that their data is safe and will be there if they need to access it. But what we see in the making of the backup is a blend of technologies and a creative element that allows administrators some work around constraints like budget and man power.
As data evolves, we are seeing multiple layers of protection and depending on the severity of the data will determine the recovery point and recovery time as well as retention period. Backup technologies usually mean more than doing a bunch of incrementals and then a full off to disk pools and then tape. There are many different levels of protection that we can use. Snapshots seem to be more common today than 5 years ago. They allow for a clean and consistent recovery point of a database or file system. But snapshots are used for more than just a quick backup, with writable copies we can quickly setup copies for test and dev environments and also rapidly deploy virtual images for desktops or servers. Snapshots are usually set to the same disk set that data is sitting on, and can be moved around via a vault technology or a mirror to another site. This can be used for long term storage if needed but typically snapshots are used for quick recoveries of less than 7 days. Snapshots are also vulnerable to data corruption. If a software bug comes in and corrupts data on the storage system, that can effect the snapshots and mirrors.
Backups are more traditional where the file system is scanned for changes and then those changes are sent off to a device where the data is stored until needed. In the past it has taken more time to backup file systems and as storage has gotten larger, those backup times grow longer. The technology has tried to keep up with adding larger backup servers and more tape drives allowing for more streams coming in. Now with the idea of using spinning disk for tape pools, we can backup a little quicker as the disk can write data faster than tape. There are many things that have evolved out of this technology, for example Long Term File System or Hierarchical Storage Management.
When clients are looking for strategies on protecting their data, they will use a combination of these techniques, and a mixture of both disks and tape to fully protect their environment. Depending o the data type, you may want to just use snapshots as the data changes rapidly and you do not need to restore from a week or a year ago. Snapshots are really useful in the case, and so is mirroring or even metro mirroring if the RTO is small enough. There are other factors such as Sarbanes-Oxley that will require longer term recovery methods like backups.
Just like a great wine, there is fewer rules today and room for creativity in designing data protection. And just like wine, there are many consultants that will help you find a good balance of technology to match levels of protection with data. Spend the time looking at your protection schemes and see if there are any better ways of balancing this equation. Maybe, with the right planning, you will be able to enjoy a glass of wine instead of spending time recovering from a disaster.
One of my favorite TV programs is the BBC show Top Gear. They go through and test cars not only for handling, looks, and cup holders but mainly for power. At the end they run all of the cars through the same test track and get a time. That time then gets recorded on their list of all the cars tested and is celebrated for achievement or scorned at for doing poorly. No matter what the car turns up, they were all treated equally.
Today, IBM is announcing a test done by a certain benchmark called SPECsfs. This has been the yardstick for all NAS vendors wanting to flex their muscles and show how they handle small block I/O. Vendors can bring how ever many drives and tweaks they want but the test itself is very rigid and has to be certified before the results are published. IBM put together a SONAS system consisting of 10 interface nodes and 8 storage pods with all SAS disk. A total of about 900TB of usable disk, and about 1/3 of the maximum SONAS configuration. There was no solid state disk or extra tweaks done just a SONAS system that you could order today. That said, the IBM SONAS set a new world record for performance for a single file system at 403,000 IOPS per second.
Yes you read that right, 403k IOPS in a single file system. If you look at the other vendors they have used multiple file systems to aggregate the performance together in order to achieve a benchmark. Then they tend to use a virtual name space with software that is layered over all of the file systems, but here SONAS is one file system over 900TB with a true global name space. Some issues with multiple file system is they cannot stripe data across the file systems and the load balancing becomes an issue. If you look at the comparison of performance per file system, you can see that IBM is WAY beyond the competitors.
So you maybe asking, "Yeah that's pretty cool but what was the response time?". According to the test, the average response time was 3.23 MS from 0 to 403k IOPs per second. This is extremely good and when you think that was coming from one file system of 900TB, you realize how good that number is compared to other results. There will be tons of vendors trying to debunk how IBM out performed them and how they have better software or better market share but it really boils down to these key points:
An all-spinning SAS disk SONAS configuration, typical of SONAS configurations being installed today
Single file system featuring ease of use, minimum complexity, global load balancing, sharing of resources, proof of scale
903 TB usable capacity is indicative of current real life customer scale out NAS requirements
An environment in which all applications would benefit from the single file system and benefit from the high IOPs and excellent response time
One can clearly correlate the SONAS SPECsfs benchmark with the response time received to a real world application by today’s SONAS
I have included the slide deck for the announcement below. Feel free to check out the information on the SPECsfs website.
I was driving into the IBM Almaden Research Center and just enjoying the beautiful scenery of the San Jose area. The campus is on top of a hill and surrounded by farm lands. I would really like to have a corner office here, but I don't think I would get much done. So here is my Vlog for this morning and I am hoping to get some interviews on here from some of the presenters and attendees.
Day 1: Today, IBM has massed the troops together to learn more about the SONAS product and how the product will look in the near and far future. There is a ton of information they are dumping that I need time to just process it all. Its also nice to meet people from all around the world that have the same mission as I do. I hope to get some interviews tomorrow as well as listening to Sven Ohme talk about performance of the box.
This video is shot in front of the first hard drive, ever. What a testimonial to the IBM innovation. The first words written are..... you gotta watch to find out.
I am headed out west to learn more about SONAS and the future of the product. I think there will be lots of good information that I will try to share with you. If you have any question that you want to ask a SONAS developer, let me know as they will all be there!
There is an ancient proverb that says " When you have only two pennies left in the world, buy a loaf of bread with one, and a lily with the other.". There is some wisdom in this old saying that we can still apply to today's IT budget and strategy. If you have been keeping up with the news, you would know companies are starting to invest again in their IT hardware and software. This maybe the turn in some of the hardest times in the hardware business. But what are customers really buying and planning to buy with their dollars? What is my bread and what is my lily today? The bread represents nourishment of the body. We have to eat in order to keep going. With out it, we starve and eventually die. This would be the basic part of a business IT strategy. What do you have to do to keep the lights on? I have this conversation with IT planners all the time. People love to do the newest and greatest, but have a smaller understanding or take for granted the things they have to do to keep the business going. The lily is a beautiful and majestic flower. Dating as far back as 1580 B.C., when images of lilies were discovered in a villa in Crete, these majestic flowers have long held a role in ancient mythology. Derived from the Greek word “leiron,” (generally assumed to refer to the white Madonna lily), the lily was so revered by the Greeks that they believed it sprouted from the milk of Hera, the queen of the gods.
The storage market is evolving with the help of cloud storage, unified platforms and consolidation. IT planners and CIOs are dealing with a new way of putting value to these terms and offering their business units a charge back model not only based on data consumption but throughput and retention. The smarter businesses are seeing that running multiple storage platforms with trapped efficiency does not work in today's data center. Storage has to be big, wide and easy to use. Long gone are the days where 10-25 TB were a big deal. We now see systems that start at those levels and go to infinite proportions. Networks are becoming faster and even consolidated with 10/20 gbps driving protocols like FCoE and iSCSI. Backups are being replaced by better replication algorithms that have quality of service levels and automated failover.
NAS storage can take advantage of these technologies that can also help you keep the lights on. Most businesses have some form of NAS storage to help employees share documents, spreadsheets, images, and what nots. There is a movement from the traditional block based systems to unstructured data sets using NAS and these are pushing the market and vendors to come up with better NAS products. Companies like Amazon, Facebook, Twitter, all push vendors to think about how they do storage.
So how are you planning your IT spending are you going to spend more on things that you have to have or will you spend more on the things that look nice? I suspect in most cases there will be an 80/20 split of bread to lily ratio. But how you classify what is needed and what is 'nice to have' in your IT department will change as your business changes this year. Businesses are putting more demand on IT with fewer resources. Even though there is evidence businesses are spending more the hardware recently, the resources (admins) are still not there. The only way companies will be able to achieve success with such a high demand on storage with out the resources is to have simple, scalable storage that allows single admins to manage multiple petabytes of storage.
IBM is working to help customers achieve this type of new IT department. Cloud is one way, either public or even private, but also from a basic system level. Interfaces that are less complicated like the V7000 or XiV allow admins to move easily with out much training. SONAS offers large scale out NAS storage where storage and throughput can be scaled independently.
This year, take time to figure out what is needed and what will be cool to have in your department. Technology will always change, even if its a change back to what we had 20 years ago (mainframe/virtualization). Keep in mind it might look like a lily today, but will be a loaf soon, where do you want to be when the business needs it.
First, off I want to say what an awesome year IBM had in storage! We announced several new products and improvements to older ones. SONAS was one of the NAS product of 2010 at IBM. The idea that came from bringing a parallel file system and merging it with commodity parts is brilliant. People have been building these systems for years and having to deal with the issues of interoperability and supportability, can now focus more on making storage work for them. Real Time Compression was also released for the N series product. This was an acquisition that really helps IBM position compression technology in the NAS market. RTC today is an appliance that compresses the data into smaller packages with no performance degrade. I believe we will see more of this technology spread into other aspects of storage line.
The biggest storage announcement was definitely the introduction of a new mid-tier storage device, Storwize V7000. This device is based on the tried and true SVC code base with some new enterprise class features from our DS8000 line. This system has the cool XiV like interface and a very cool form factor and with things like easy-tier and disk virtualzation, the box is going to be hard to beat in 2011.
Second, I want to honor IBM as we celebrate our centennial year of business. The Computing Tabulating Record Company started on June 15, 1911 and while the name has changed and our products and services have changed, but our mission and dedication to our clients remains unchanged. So many of us do not even begin to understand the role IBM has made on our world as it is today. IBM has been well known through most of its recent history as one of the world's largest computer companies and systems integrators. With over 388,000 employees worldwide, IBM is one of the largest and most profitable information technology employers in the world. IBM holds more patents than any other U.S. based technology company and has eight research laboratories worldwide. The company has scientists, engineers, consultants, and sales professionals in over 170 countries. IBM employees have earned Five Nobel Prizes, four Turning Awards, five National Medals of Technology and five National Medals of Science.
Lastly, I want to challenge everyone, IBMers, clients, everyone, to really look at what is going on in the storage space this year. With the explosive growth of data we are seeing people buying unprecedented amounts of storage. Most of the vendors are going to be investing in R & D for storage and coming out with new and time saving features. Clients should challenge their vendors to exceed their requirements not just make them. I also want vendors to look beyond products and start looking the services that help clients make better decisions and support the products they have purchased.
I am always blown away with the expertise and insight our Advanced Technical Services team displays. They are our “Go To” guys for driving technology to our field teams and they are the last resort before getting into a development team. For me, they are a well of information and experience that I can use to help build solutions.
Today, I am sitting in the SONAS system training with Mark Taylor. Mark and I have been working together at IBM for a few years and I have the most respect for him. Mark is responsible for supporting the N series and SONAS at IBM along with a few other team members. He has is known for being a stickler on our solution assurance calls and is always finding solutions for our clients.
Our mission this week is to learn more about storage products on a deeper level. Many of the technical sales group has specialty that they focus on. It could be XiV, SONAS, Mid-Tier storage, what ever.This week, when we leave on Friday, we should come away as more rounded technical experts.
I am still amazed at the SONAS product and how powerful it really is, especially compared to other products in the market place. I find it hard to compare to other brands due to great feature set it brings and integration with TSM. No other storage out there is able to provide unstructured NAS data a platform to live on from cradle to grave like SOANS.
This mimics how IBM is doing more solution selling in the marketplace.Our Storage team is partnering with the POWER team and the Software teams to provide customers with a ‘one stop’ solution. If you look just at the SONAS product, it has multiple components all from IBM; X series servers, TSM and GPFS software, XiV storage. We are finding that if we combine these products into a solution based product, customers can solve more issues with the same amount of dollars. I believe this is the future of IBM storage and storage in general.
SONAS does have a couple of points that I would like to see cleaned up. One is the GUI, and the other is its policy writer. From what I can tell, the information in the SONAS GUI is very similar to that of the XiV system. It just has a different look and feel.With the Storwize V7000 getting the ‘XiV’ look and feel, I suspect future releases of SONAS might get the same treatment.As for the policy engine, it’s all based on SQL Query language. If you know how to write it then it’s not an issue but there are some out there that might not be privy to such skills. There are some guidelines and examples that can be used to help setup the policies like moving data from one pool to the next but I suspect people will rely more on their Technical Advisor to help define those rules.
Tomorrow is all about protect tier.I am excited about the hands on and finding how this box can really save people space with their backups.
Well the last two days have been crazy with really good sessions, lots of networking with tons of people and great discussions throughout the entire conference. The sessions have been well attended and people are really asking great questions. For the most part, I hear that everyone is learning from the sessions, which I hope they dont get overloaded with so much information. Today I presented on PAM II technology for the N series system. We disussed the need for large Read Cache systems and how its not only the size of the disks that are driving this need, but also the business requesting for lower return times on data. During this session, the question was brought up about the new acquisition of StorWize and how that would effect the NAS solutions at IBM.
Here is IBM VP of Storage, Doug Balog, talking about the product.
I think its going to be a good product to put in front of our NAS systems and it will drive the heavy read cache systems like PAM II and the huge amounts of cache in the SONAS systems. Speaking of StorWize, I wanted to give everyone a little more information about this product and maybe why IBM purchased them. They provide real time compression technology that will reduce the storage need by compressing the data into images. They have an engine called Random Access Compression Engine (RACE) which is just a compression algorithm that does the conversion with no overhead. The Storwize appliance will work with popular NAS systems, including IBM N series and SONAS, as well as non-IBM NAS systems from EMC, HP, NetApp and others. Storwize real-time compression can provide added value to clients already using data deduplication, thin provisioning and other storage efficiency technologies.
I am at the IBM Storage University this week with the hope to spread the good word about NAS technology at IBM. The opening session was awesome and SONAS was mentioned a couple of times as part of the IBM Storage strategy. Listen below to a few remarks (short clip) from IBM VP Storage Doug Balog.
My session on NAS technology was well attended and people asked thoughtful questions. We talked about the N series and a couple of new features we have been adding through out the year. Then we talked about the SONAS platform which I think is one of the hottest topics being discussed here this week. I also worked in the solution center where all of the vendors setup booths even Netapp, who is a platinum sponser came with a very large booth this year, right at the door. I didn't get a chance to talk to that team afterward but I hope they were able to speak to alot of people here about N series.
I had a ton of people coming by and asking about SONAS, and not just what is it, but how can it help them.
Today there are some great sessions that I am hoping to attend. One is a N series client from IBM talking about Managing the Largest AGFA PACS solution in the Americas. Then there is my session on ILM/HSM in the SONAS system. I am hoping we will have a great turnout for that ! There are so many sessions that I want to attend, I need to clone myself so that I can get them all.
Just a quick note on two new Solution Briefs that were posted to the IBM SONAS front page. These briefs have important information on using Symantec's EndPoint and NetBackup to protect data on the SONAS system. As always, the devil is in the details but this gives SONAS clients a look into how we can utilize these two solutions with the very powerful SONAS system.
I am also headed up to the IBM Storage University to present on NAS technology at IBM. If you get a chance to stop by and see one of my sessions, please come up and give me feedback on the blog (and other things). I will also be in the Solution Center at the SONAS booth.
There is always a part of the business that gets over looked and usually its the people that are in the trenches making things work and keeping those machines going. I recently had the pleasure of spending some time with three great IBM CEs here in the Raleigh NC area. I was impressed with their professionalism and thoroughness while working on the SONAS upgrade. They made sure everything was installed, cabled and tabled according to the documentation. It is one thing to have a great product and lots of features, but it is even more important to have people who can service the system and do it with the highest level of craftsmanship. Thanks guys and gals for everything you do to help make our job easier!
Today, I helped our local Client Engineers install a couple of new nodes and some more storage into a local SONAS system. This was exciting for me as I love working with the hardware and software and it keeps up my keyboard skills. This client is bringing online more demand and needs both horsepower (interface nodes) and storage to accommodate a new business line. I was amazed at how easy the system is to upgrade and soon his little starter rack is almost full. We added two interface nodes, IBM xSeries 3650 m2 and two 60 disk shelves to the unit. Once the disks are online and presented up to the interface modules, they can start creating shares for the new operation. As they need more storage or more interface nodes, another rack will be but in and the same process of pooling these resources together will come together. The idea of having multiple interface nodes and storage pools is to not have single points of failure. In traditional storage, if a controller goes down, its partner has to pick up the entire work load for the down hardware. Not so in SONAS, if a controller goes down, the work is then evenly spread across all of the other nodes in the system. This is why we do not have a problem of loosing CIFS connections when systems go down. The addition of new storage is also interesting as we are tripling the amount of storage the base system had originally with two 4 U shelves. These shelves are highly dense, top loading containers using either SAS or SATA disks. In this instance today, we were installing 120 2 TB SATA drives. A total of 240TB in 8 U of space. Not too shabby. At the end of the day, I was pleased to see that IBM is moving forward with smarter storage systems. If you look at the entire portfolio, you can see that our systems like XiV grid, the auto tiering on DS8700, SVC virtualzation, all of these systems are helping our goal of a Smarter Planet. Look for some more pictures and maybe a video on Monday.
IBM has been working to enhance the way we do business from day one. From clock, to typewriters, mainframes, PCs, software, storage... the idea behind our innovation is to make it easier for our clients to do their business. Now we are taking it one step further to help our clients make the world better.
If you have been watching standard TV, Youtube or Hulu, you probably have seen a commercial for the IBM Smarter Planet initiative. These great adverts keep the tradition of IBM marketing our message to the masses. They describe how IBM is making our world better by using technology through many disciplines; Healthcare, Traffic, Food, etc. If you dig a little deeper than the catchy ads, you see a real movement not only to 'save the planet' but to make our lives better.
One of the ways IBM is making our planet better is by increasing the utilization of our systems. Today's average commodity server rarely uses more than 6% of its available capacity. This hold true for our storage systems as well. We find storage systems are bound by traditional technologies that keep us from keeping up with demand.
Looking at how this relates to my involvement I see how both SONAS and N series fit this mantra. The technologies allow clients to conserve energy by decreasing the amount of storage needed to achieve typical installations.
N series software allows a client to over subscribe a system by cloning the volumes with out adding additional space. This software called FlexClone allows clients to use products like VMWare, Xen or Hyper-V to create zero space copies of the original image. This zero consumption keeps the original blocks locked to the original image and any new changes are added to the free space as a delta. In traditional storage systems, a 10GB image would consume 1 TB for just 100VMs. With FlexClone, the only space needed for all 101 VMs would be just 10GB. Lowering both the OPEX and CAPEX for this system.
The IBM Scale out NAS system (SONAS) is a gaining steam as the private cloud business has increased in the business market. Not only are research universities and high performance computing labs seeing the benefits, so are mid-market to enterprise business leaders. Typical storage systems are not utilized to their full potential because of the purpose of the system or how it was integrated into their data center.
With a SONAS system, we no longer have to think how this system will be provision as all of the equipment can respond to requests from multiple parts of the business. If you have 5 systems that provide storage to your business and one of those systems is struggling to keep up with demand, the only way to keep up with the requests is to move data off by hand to the other systems. This is time consuming and could introduce mistakes and possible data loss. SONAS allows clients to be flexible in a dynamic-on-demand business environment. No longer will you have one system slowing down productivity as all of the storage in a SONAS system can be distributed through out the entire client interface. This will increase your efficiency rates and lower the required amount of systems in your data center, lowering environmental cost, CAP/OPEX.
There are other Storage systems that can increase utilization, Information Archive moves older data off to low cost, slower disk allowing you to store more on primary, faster disks. XiV keeps data spread throughout the entire system in case of a failure with no traditional RAID overhead. We at IBM are constantly looking for ways to increase the utilization of our systems.
IBM is working hard to build a smarter planet that not helps our clients, but helps the human race. Either through smarter storage systems, servers, software or consulting, IBM is working hard to bring this vision to a realization. Take a look at your systems and take stock of their utilization. Can they be doing more for you? Find out more about the IBM Smarter Planet initiative here.
I was working with a company today that had 5 storage vendors supplying gear for their data center. They were interested in SONAS not only for the scalability but for the idea that we could consolidate their storage footprint from 5 vendors to 1 with out having to sacrifise performance. Now must vendors would say, sure we can rip and replace all of the storage there and replace it with their own, but can they do it to the same scale (both horizontal and vertical), with a high performance engine like GPFS, one global names space and one single management tool? The customer was really impressed by our solution as is very interested in how we can help him go from 40+ racks of storage down to 13 and increase his efficiency. The idea is to use multiple teirs to put meta data on the faster disk, data that is being accessed currently on a medium speed and then 'near to archive on slow, fat disk. Currently they have no way of moving data between their 5 different systems. This causes them to keep running into issues where they are buying expensive disk to run applications/databases where they have data that is stagnant or non as important on the existing fast disks. SONAS will allow them to create pools of storage (tiers) and policies to move the data between the pools. Then with the HSM integration, the data can be archived off to tape until needed down the road. From a cost perceptive, the cost associated with the size and speed of the disk match their purpose with out them having to manually move the data themselves. With IT departments that have a huge growth in storage and are not hiring more admins, this makes sense. They can set the policies up front and not have to worry about some old file sitting on a expensive SAS disk. The other expense savings is in support contracts. The reduction from five support contracts to one will save customers money, and allows them to have one place to get all of their support. I can not wait to start work on this account as it looks like we will be putting in a great system and helping a client save money.
I was on my way down to Miami today and was talking to the gentleman sitting next to me about storage technology and the conversation turned to how everyone is scrambling to be in the cloud business. He had heard multiple vendors come in and start talking about cloud technology and how it was going to save him money, time and effort. This gentleman worked for a retail chain that has multiple district offices through out the eastern US and headquarters in Atlanta. He has multiple technologies all helping him keep the business running but nothing planned and as the company grew, they simply cookie cut the previous installation and planted it into the new office. Each office would also replicate back to HQ and that would be the main repository for backups/restores. I would guess there are thousands of companies out there with similar setups. So instead of going into how he could leverage cloud storage technology, I asked him what were his problems and listened. They basically came down to this: 1. Multiple independent islands of storage that are aging, causing his support contracts to go up. 2. Backups take way to long and systems are slowing down as they get closer to 'capacity'. 3. Future growth was expensive as every time they added a new capacity, they had to add entire systems. Now they were not cutting edge technolgy leaders nor were they wanting to be, but he needed a way to solve some of these traditional storage problems. He didn't want to go out and buy a new large system that would take forever to get in and while it may solve his problems, it would bring in even more issues. What he needed is less overhead and more throughput. We sat there for a while thinking, we didn't say much until I offered this tidbit, "So what does cloud mean to you?" After a nice laugh, he stated that he really didn't know and the more he read, the more 'cloudy' became the answer. There are many interpretations about what cloud really is and it differs between storage vendors. If there is a true declination of what cloud storage really could be, I think it could be defined using NAS technology. NAS lends to be a kinder and gentler protocol set and the need is growing leaps and bounds. Our traditional way of adding more systems and creating more independent silos works for smaller environment but it does not scale when clients want large disk pools of storage under one umbrella. There are ways of making volumes span in to large pools but the underlying storage is still made up smaller components that are typically active/active/passive nodes, even the best load balance will not help if you are overloading that system. There are ways to find a balance between the same old way and going out and dropping tons of cash on huge storage gear. Find a system that will grow and scale as your storage needs do. Think of ways to keep everything under one umbrella (name space for example) and also try to solve issues that you are having today with real technology and not work arounds. With NAS technology, we will always be at the mercy of the backup target whether its disk or tape. No matter if we are taking snapshots or ndmp backups, we have to write that out to some target to have a restore point. This is your basic strategy on how to do a backup/restore, why not consider using different types of disks to create a tier and offload disks to slower pools as the data gets 'older'. A few vendors have said there is no need for tiering, mainly because their systems can't take advantage of this and therefore they shun those who do. ILM tiering can help you achieve not only higher utilization rates with the storage but it puts the data that is accessed more frequently on faster disk, and moves the rest away to makes more room. Why pay for fast disk if the data on it is not being accessed frequently? Future expansion has always been tough for administrators, they tend to over buy on controller size and skimp on the disk. Systems like SONAS from IBM allows you to grow both in storage capacity and server throughput; independently. If a customer needs more storage but doesn't need the additional throughput, why force him to add more controllers? SONAS systems can scaled up to 30 storage servers and 14.4 PB of spinning disk all under one name space. No more having multiple nodes with their own names; this storage is called Accounting1, Accouting2 .... etc. They are called Storage and everyone gets the benefit of having all of the nodes, not just one system. By the time we had gone through all of this, our flight was landing. It was a great talk and both of us gained a different perceptive on how cloud is perceived. If any of you want to find out more information about the IBM Cloud strategy or SONAS go to the following links: IBM CLOUD SONAS by IBM
This weekend I was working on moving some of my winter clothes and spring/summer clothes in and out of my closet and into containers. Last Fall I purchased a few plastic containers that sealed so I could put my short sleeve golf shirts away and some of my shorts. Here in North Carolina, we can get a mild day and it is nice to have a short sleeve shirt to wear. On these days I would go back to the containers and dig through the nicely folded items until I found the shirt I wanted. Sometimes I had to go through multiple containers because I had forgotten which one I had put it in a few months ago. This weekend when I pulled out the containers they were in a mess, nothing was folded and it took me more time trying to figure out what was what as they all were mixed up. I then wondered what if I bought a bigger container and instead of using multiple ones, I could use one large container to store all of my winter clothes? What would the issues be, would I have enough space to store the container? Would there be someway of indexing the clothing inside to quickly find what I was looking for? Was there a way to put some clothes that I would need in case of cool day in a separate container just in case I needed them? There seemed to be more issues with just using one larger container than I thought. It would be easy to dump all the clothes into the larger bin and claim victory but that did not help me down the road. I needed a system, something to help me consolidate efficiently while still giving me access to those things I used on occasion. I also had to keep in mind the space I was going to use in my storage area. I didn't want to buy one large container and not be able to get it in the space I already had allocated. I needed a flexible system, maybe a few boxes that had labels and I could get to quickly if I needed something inside. Take a look at some of the noise some of the storage vendors are making about data storage consolidation. Most of them are telling you we can come in and take your smaller boxes and dump the data into one big box. While that helps on saving you space and might keep you from administrating multiple storage devices, you need to look at the downside of just having one big pool of disks. A large storage system that is replacing multiple smaller systems will need more cache and processor power to handle the same load as before. If you want to move data around to different tiers of disks or tape, can you achieve that with the new system? I started down the road of buying the biggest container I could find but decided against it as it would be too much trouble to find things. Your data storage systems need to be flexible enough to have multiple storage pools so that data that is able to move off faster disk and make room for data that is accessed more frequently. This not only allows your clients to have better response times on files they frequently use, but it tells you how much 'real' data people are using in your data center. The other issue I had was I needed some type of labeling systeming or an index to tell me where the shirts were and were was my ski jacket, etc. Your data is much the same, you need to keep up with where data lives in the storage system. As our storage systems get larger, we need save the meta file data easily and keep it in a table so we can run queries against it. There is also last part of moving my clothes around that I hated the most, the purge. I went through and found the shirts that had been worn too many times or may not fit the same as when I bought them originally. I packed these in a cheap cardboard box and took them to a donation place. This is the same as getting rid of old data in your system. Old data that is not being accessed is costing you money. You not only have to pay the environmental cost of keeping those bits spinning, but its taking up room where new data could reside therefore costing you money to expand. True archive and purging of data will be needed for any system large or small. Make sure you find a system that is easy to work with and automates this process based on policy. In the end, if you are looking at consolidation of your data storage, there are multiple things you will need to find out about a system. Just because a bigger container can replace multiple smaller containers may not give you the flexibility needed to meet your changing needs. For more information on a better way to consolidate your storage platform and moving your data, check out the information on SONAS and TSM.
Sorry Bill, there is a new question burning in our minds today. There seems to be a lot of buzz lately about tiering your data storage and who can and who can not, why and how but not alot of people are talking about when to tier your storage. Netapp has indicated they are not as concerned with a tiering approach and this is true for the IBM XiV product. Others like 3par and IBM' SONAS has it built in for clients to move data from one pool to the next. But how does one gauge this old standard of giving the best to the most demanding and the least to the dregs of our storage footprint?
Tiering can be based on performance needed from the client/application or the length of time and frequency of use. Some vendors will come out and say we treat all data the same and can shift needed resources to more used areas of the subsystem. And some allow you to create pools of storage to allocate cycles for just that application. The main difference is what happens when a system is over subscribed, do you have a guarantee without the pools that your application will always get the set performance it needs. Archival tiering allows you to move data that has a lower frequency of being accessed to lower cost (large and slow) disk and then to tape. The movement from pool to pool is based on either rules or policies set by the administrator based on date or time. This is a bigger issue with NAS data than SAN due to the nature of NAS files.
An indication of when to tier is the size of your storage system. Is it worth to create three tiers of storage for a 5 - 10 TB storage system? Probably not and there are simple ways of isolating storage for higher performance that has been tired and true. If your storage doesn't have built in tiering, you can use isolation of drives to increase the amount of performance to an application. You can also use higher amounts of cache like the N series PAM cards. This can decrease the latency response time and improve your application performance by adding additional read cache.
A larger system that has 100 TB and up would be ideal for tiering based on performance. As your storage grows there is data that needs to be on fast disk and data that can live elsewhere. Think of your storage as a tool chest of wrenches, screwdrivers and sorts. As you get more tools in your tool chest, you will want to keep those used more frequently in the top where you can get to them quickly like the trusty screwdriver that does both Phillips and flat head screws. But the tools that used less can be in the shelves below, sorted by either size or frequency of use.
Tiering data may be important to you as your build out your system and maybe you need to implement it day one. With the growth in the digital media, whether you are taking pictures for a marketing campaign or producing a new digital movie, we will see data storage grow ten fold in the coming years. I suspect tiering will be needed more for these projects as their data plat form scales out quickly and the smaller storage units will be used as secondary units in field offices or retail stores. Either way, you will need to evaluate whether to tier or not to tier based on your storage needs today and in the coming future. Would Shakespeare believe in tiering? Only if it sold more tickets for his play maybe...
There are few times that I look at what a company markets as the 'Next big thing' in the storage world and get the same reaction I got when I started learning about the SONAS product. There is already some technical details in the announcement and in Tony's blog from a few days ago so I wont go into that today, but I will go over how this product really makes a paradigm shift in the NAS storage world.
Traditionally NAS storage is looked as the little brother to the bigger systems of SAN. SAN systems tend to be the athletes of the storage high school with their matching letter jackets and oversized girth. All the while, NAS was the band geeks, some frail and thin and some over sized but always in large numbers and not very organized. NAS technology was born from the need to share data over he company and as the amount of information grew so did the servers, network bandwidth and backups. SAN storage is still the big guy on campus but the people that track trends for our industry say NAS has become just as important as the large databases, ERP systems and the like.
If you look at how we have stored NAS data, it has been on single file systems that had local disk drives shared out over a single 10/100 mb network. As storage systems became more advanced, we saw people using clustering, snapshots, thin provision, de-duplication and replication to help keep our companies communicating. When we needed more throughput or more storage we added a server or added disks which created islands of unshared power.
If you look at 2009 and one of the hottest buzz words in the storage market, it was cloud computing. Having a large source of power in one area to pull resources from without having to provision new equipment. We also saw more and more clients looking at NAS protocols as the Ethernet could support faster speeds than traditional fibre channel. A huge amount of you have been looking at and moving your virtual environments to NFS to help cut down on administration overhead and to take advantage of the CNA technology.
With a higher demand for NAS technology, comes the burden of being able to scale at the same rate the storage, network and throughput increases. Older NAS systems allowed clients to increase the amount of storage but once you reach the critical mass the system allowed you had to purchase another clustered system. This creates multiple islands of storage pools that have be managed, provisioned and backed up. Not a great solution for companies that are growing and have fewer administrators to do the work.
Now, IBM has a product that allows our NAS clients to grow and scale as their companies grow. SONAS is a highly scable NAS that works like a cloud. The underlying technology, GPFS, is the same found in some of the fastest computers in the world. SONAS uses a method of scaling in both storage and throughput by adding storage pods (60 SATA or SAS disks) or interface modules (x3650 servers) like Lego blocks. All of this is managed by a central command module that allows a client to have full control over the entire system no matter how much storage or servers are in the system.
So the "Next big thing" in my opinion is here today and IBM is using the best of the best of IBM research for it's clients. The SONAS solution is designed from the ground up as a true blue NAS storage solution. Look for future SONAS blogs on GPFS, creating an ILM strategy and more.