• Share
  • ?
  • Profiles ▼
  • Communities ▼
  • Apps ▼

Blogs

  • My Blogs
  • Public Blogs
  • My Updates

LATEST TRENDS:

  • Log in to participate
Tony Pearson Tony Pearson is a Master Inventor and Senior IT Architect for the IBM Storage product line at the IBM Systems Client Experience Center in Tucson Arizona, and featured contributor to IBM's developerWorks. In 2016, Tony celebrates his 30th year anniversary with IBM Storage. He is author of the Inside System Storage series of books. This blog is for the open exchange of ideas relating to storage and storage networking hardware, software and services.
(Short URL for this blog: ibm.co/Pearson )
Facebook,   Twitter,   LinkedIn,   RSS Feed 

My books are available on Lulu.com! Order your copies today!

Featured Redbooks and Redpapers:

  • IBM System Storage Solutions Handbook
  • IBM Software-Defined Storage Guide
  • IBM Private, Public, and Hybrid Cloud Storage Solutions
  • IBM Spectrum Archive Enterprise Edition V1.2: Installation and Configuration Guide
  • IBM Spectrum Scale and ECM FileNet Content Manager Are a Winning Combination
  • IBM Spectrum Scale in an OpenStack Environment


IT featured blogger BlogWithIntegrity.com HootSuite Certified Professional

Links to other blogs...

  • Accelerate with ATS
  • Alltop - Top Storage Blogs
  • Anthony Vandewerdt
  • Barry Whyte (IBM)
  • Bob Sutor (IBM)
  • Brad Johns Consulting
  • Chris M. Evans
  • Chuck Hollis (Oracle)
  • Corporate Blogs
  • Greg Schulz
  • Hu Yoshida (HDS)
  • Jim Kelly (IBM)
  • Jon Toigo - DrunkenData
  • Kirby Wadsworth (F5)
  • Martin Glasborow
  • Raj Sharma, IBM Storage and Te...
  • Richard Swain (IBM)
  • Roger Leuthy, Storage CH Blog
  • Ron Riffe, "The Line"
  • Seb's SANblog
  • Stephen Foskett, Pack Rat
  • Steve Duplessie (ESG)
  • Storagezilla
  • Technology Blogs
  • Top 10 Storage Blogs
  • VMblog by David Marshall

Archive

  • March 2018
  • February 2018
  • January 2018
  • December 2017
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • July 2017
  • May 2017
  • April 2017
  • March 2017
  • February 2017
  • January 2017
  • December 2016
  • November 2016
  • October 2016
  • September 2016
  • August 2016
  • May 2016
  • April 2016
  • February 2016
  • January 2016
  • December 2015
  • November 2015
  • October 2015
  • September 2015
  • May 2015
  • April 2015
  • March 2015
  • February 2015
  • January 2015
  • October 2014
  • September 2014
  • July 2014
  • June 2014
  • May 2014
  • April 2014
  • March 2014
  • February 2014
  • January 2014
  • December 2013
  • November 2013
  • October 2013
  • August 2013
  • July 2013
  • June 2013
  • May 2013
  • April 2013
  • March 2013
  • February 2013
  • January 2013
  • December 2012
  • November 2012
  • October 2012
  • September 2012
  • August 2012
  • July 2012
  • June 2012
  • May 2012
  • April 2012
  • March 2012
  • February 2012
  • January 2012
  • December 2011
  • November 2011
  • October 2011
  • September 2011
  • August 2011
  • July 2011
  • June 2011
  • May 2011
  • April 2011
  • March 2011
  • February 2011
  • January 2011
  • December 2010
  • November 2010
  • October 2010
  • September 2010
  • August 2010
  • July 2010
  • June 2010
  • May 2010
  • April 2010
  • March 2010
  • February 2010
  • January 2010
  • December 2009
  • November 2009
  • October 2009
  • September 2009
  • August 2009
  • July 2009
  • June 2009
  • May 2009
  • April 2009
  • March 2009
  • February 2009
  • January 2009
  • December 2008
  • November 2008
  • October 2008
  • September 2008
  • August 2008
  • July 2008
  • June 2008
  • May 2008
  • April 2008
  • March 2008
  • February 2008
  • January 2008
  • December 2007
  • November 2007
  • October 2007
  • September 2007
  • August 2007
  • July 2007
  • June 2007
  • May 2007
  • April 2007
  • March 2007
  • February 2007
  • January 2007
  • December 2006
  • November 2006
  • October 2006
  • September 2006

Disclaimer

"The postings on this site solely reflect the personal views of each author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management."

(c) Copyright Tony Pearson and IBM Corporation. All postings are written by Tony Pearson unless noted otherwise.

Tony Pearson is employed by IBM. Mentions of IBM Products, solutions or services might be deemed as "paid endorsements" or "celebrity endorsements" by the US Federal Trade Commission.

This blog complies with the IBM Business Conduct Guidelines, IBM Social Computing Guidelines, and IBM Social Brand Governance. This blog is admistered by Tony Pearson and Sarochin Tollette.

Safe Harbor Statement: The information on IBM products is intended to outline IBM's general product direction and it should not be relied on in making a purchasing decision. The information on the new products is for informational purposes only and may not be incorporated into any contract. The information on IBM products is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. The development, release, and timing of any features or functionality described for IBM products remains at IBM's sole discretion.

Tony Pearson is a an active participant in local, regional, and industry-specific interests, and does not receive any special payments to mention them on this blog.

Tony Pearson receives part of the revenue proceeds from sales of books he has authored listed in the side panel.

Tony Pearson is not a medical doctor, and this blog does not reference any IBM product or service that is intended for use in the diagnosis, treatment, cure, prevention or monitoring of a disease or medical condition, unless otherwise specified on individual posts.

Posts by date
  • Sort by:
  • Date ▲
  • Title
  • Likes
  • Comments
  • Views

Storage Symposium 2009 - Day4 Linux Directions

| | Visits (7527)
IBM Symposium

Continuing my week in Chicago, at the IBM System x and BladeCenter Technical Conference, I attended an awesome session that summarized IBM's Linux directions. Pat Byers presented the global forces that are forcing customers to re-evaluate the TCO of their operating system choices, the need for rapid integration in an ever-changing business climate, government stimulus packages, and technology that has enabled much better solutions than we had during the last economic turn-down in 2001-2003.

IBM has been committed to Linux for over 10 years now. I was part of the initial IBM team in the 1990s to work on Linux for the mainframe. In various roles, I helped get Linux attachment tested for disk and tape systems, and helped get Linux selected as an operating system platform of choice for our storage management software. Today, Linux-based server generate $7 Billion US dollars in revenues. For UNIX customers, Linux provides greater flexibility for hardware platform. For Windows customers, Linux provides better security and reliability.

Initially, Linux was used for simple infrastructure applications, edge-of-the-network and Web-based workloads. This evolved to Application and Data serving, Enterprise applications like ERP, CRM and SCM. Today, Linux is well positioned to help IBM make our world a smarter planet, able to handle business-critical applications. It is the only operating system to scale to the full capability of the biggest IBM System x3950M2 server.

Pat gave an examples of IBM's work with Linux helping clients.

City of Stockholm

The city of Stockholm, Sweden introduced congestion pricing to reduce traffic. IBM helped them deploy systems to collect tariffs from 300,000 vehicles a day, with real-time scanning and recognition of vehicle license plates, Web-accessible payment processing, and analytics for metrics and reporting. This configuration was able to [reduce traffic by 25 percent in the first month].

ConAgra Foods

IBM helped [ConAgra Foods] switch their SAP environment from a monolithic Solaris on SPARC deployment, to a more distributed one using Novell SUSE Linux on x86. The result? Six times faster performance at 75 percent lower total cost of ownership!

North Carolina State University (NCSU)

IBM helped NCSU use Red Hat linux on BladeCenter to deploy their [Virtual Computing Lab], a Cloud Computing solution for their [30,000 students and 8,000 faculty and staff employees]. NCSU uses the Extreme Cluster Administration Toolkit [xCAT] to manage this Linux environment.

IBM's strategy has been to focus on working with two of the major Linux distributors: Red Hat and Novell. It also works with [Asianux] which is like the UnitedLinux for Asia, internationalized for Japan, Korea, and China. It handles special requests for other distributions, from CentOS to Ubuntu, as needed on a case by case basis. IBM's Linux Technology Center of 600 employees help to enable IBM products for Linux, make Linux a better operating system, expand Linux's reach, and help drive collaboration and innovation. In fact, IBM is the #3 corporate contributor to the open source Linux kernel, behind Red Hat (#1) and Novell (#2). For most IBM products, IBM tests with Linux as rigorously as it does Microsoft Windows. IBM offers complete RTS/ServicePac and SupportLine service and support contracts for Red Hat and Novell Linux.

At the IBM Solutions Center this week, several booths used Linux bootable USB sticks to run their software. [Novell SUSE Studio] was developed to help customize Linux to the specific needs for independent vendors.

Both Red Hat and Novell offer distributions in four categories:

  • Standard - for small entry-level servers, with support for a few virtual guests
  • Advanced Platform - for bigger servers, and support for many or unlimited number of virtual guests
  • High Performance Computing - HPC and Analytics for large grid deployments
  • Real Time - for real time processing, such as with [IBM WebSphere Real Time], where sub-second response time is critical.

A key difference between Red Hat and Novell appears to be on their strategy towards server virtualization. Red Hat wants to position itself as the hypervisor of choice, for both servers and desk top virtualization, announcing Kernel-based Virtual Machine [KVM] on their Red Hat Enterprise Linux (RHEL) 5.4 release, and their new upcoming RHEV-V, a tight 128MB hypervisor to compete against VMware ESXi. Meanwhile, Novell is focusing SUSE to be the perfect virtual guest OS, being hypervisor-aware an dhaving consistent terms and licensing when run under any hypervisor, including VMware, Hyper-V, Citrix Xen, KVM or others.

IBM has tons of solutions that are based on Linux, including the IBM Information Server blade, the InfoSphere Balanced Warehouse, SAN Volume Controller (SVC), TS7650 ProtecTIER data deduplication virtual tape library, Grid Medical Archive Solution (GMAS), Scale-out File Services (SoFS), Lotus Foundations, and the IBM Smart Cube.

If you are interested in trying out Linux, IBM offers evaluation copies at no charge for 30 to 90 days. For more on how to deploy Linux successfully on IBM servers, see the [IBM Linux Blueprints] landing page.

technorati tags: IBM, Linux, UNIX, Windows, Solaris, SPARC, ERP, SRM, SCM, SAP, TCO, Stockholm Sweden, traffic, ConAgra Foods, NCSU, VCL, RedHat, RHEL, Novell, SUSE, xCAT, HPC, Real Time, VMware, ESXi, Hyper-V, Citrix, Xen, KVM, RHEV, RHEV-H, SVC, TS7650G, GMAS, SoFS, Lotus Foundations, Smart Cube



Tags:  linux

Storage Symposium 2009 - Day3 XIV sessions

| | Visits (10791)
IBM Symposium

Continuing my week in Chicago, for the IBM Storage Symposium 2008, I attended two presentations on XIV.

XIV Storage - Best Practices

Izhar Sharon, IBM Technical Sales Specialist for XIV, presented best practices using XIV in various environments.He started out explaining the innovative XIV architecture: a SATA-based disk system from IBM can outperformFC-based disk systems from other vendors using massive parallelism. He used a sports analogy:

"The men's world record for running 800 meters was set in 1997 by Wilson Kipketer of Denmark in a time of 1:41.11.

However, if you have eight men running, 100 meters each, they will all cross the finish line in about 10 seconds."

Since XIV is already self-tuning, what kind of best practices are left to present? Izhar presented best practicesfor software, hosts, switches and storage virtualization products that attach to the XIV. Here's some quickpoints:

Use as many paths as possible.

IBM does not require you to purchase and install multipathing software as other competitors might. Instead, theXIV relies on multipathing capabilities inherent to each operating system.For multipathing preference, choose Round-Robin, which is now available onAIX and VMware vSphere 4.0, for example. Otherwise, fixed-path is preferred over most-recently-used (MRU).

Encourage parallel I/O requests.

XIV architecture does not subscribe to the outdated notion of a "global cache". Instead, the cache is distributed across the modules, to reduce performance bottlenecks. Each HBA on the XIV can handle about 1400requests. If you have fewer than 1400 hosts attached to the XIV, you can further increase parallel I/O requests by specifying a large queue depth in the host bus adapter (HBA).An HBA queue depth of 64 is a good start. Additional settings mightbe required in the BIOS, operating system or application for multiple threads and processes.

For sequential workloads, select host stripe size less than 1MB. For random, select host stripe size larger than 1MB. Set rr_min_io between ten(10) and the queue depth(typically 64), setting it to half of the queue depth is a good starting point.

If you have long-running batch jobs, consider breaking them up into smaller steps and run in parallel.

Define fewer, larger LUNs

Generally, you no longer need to define many small LUNs, a practice that was often required on traditionaldisk systems. This means that you can now define just 1 or 2 LUNs per application, and greatly simplifymanagement. If your application must have multiple LUNs in order to do multiple threads or concurrent I/O requests, then, by all means, define multiple LUNs.

Modern Data Base Management Systems (DBMS) like DB2 and Oracle already parallelize their I/O requests, sothere is no need for host-based striping across many logical volumes. XIV already stripes the data for you.If you use Oracle Automated Storage Management (ASM), use 8MB to 16MB extent sizes for optimal performance.

For those virtualizing XIV with SAN Volume Controller (SVC), define manage disks as 1632GB LUNs, in multiple of six LUNs per managed disk group (MDG), to balance across the six interface modules. Define SVC extent size to 1GB.

XIV is ideal for VMware. Create big LUNs for your VMFS that you can access via FCP or iSCSI.

Organize data to simplify Snapshots.

You no longer need to separate logs from databases for performance reasons. However, for some backup productslike IBM Tivoli Storage Manager (TSM) for Advanced Copy Services (ACS), you might want to keep them separatefor snapshot reasons. Gernally, putting all data for an application on one big LUNgreatly simplifies administration and snapshot processing, without losing performance.If you define multiple LUNs for an application, simply put them into the same "consistencygroup" so that they are all snapshot together.

OS boot image disks can be snapshot before applying any patches, updates or application software, so that ifthere are any problems, you can reboot to the previous image.

Employ sizing tools to plan for capacity and performance.

The SAP Quicksizer tool can be used for new SAP deployments, employing either the user-based orthroughput-based sizing model approach. The result is in mythical unit called "SAPS", which represents0.4 IOPS for ERP/OLTP workloads, and 0.6 IOPS for BI/BW and OLAP workloads.

If you already have SAP or other applications running, use actual I/O measurements. IBM Business Partners and field technical sales specialists have an updated version of Disk Magic that can help size XIV configurations fromPERFMON and iostat figures.



XIV Performance

Lee La Frese, IBM STSM for Enteprise Storage Performance Engineering, presented internal lab test results forthe XIV under various workloads, based on the latest hardware/software levels [announced two weeks ago]. Three workloadswere tested:

  • Web 2.0 (80/20/40) - 80 percent READ, 20 percent WRITE, 40 percent cache hits for READ.YouTube, FlickR, and the growing list at [GoWeb20] are applications with heavy read activity, but because of[long-tail effects], may not be as cache friendly.

  • Social Networking (50/50/50) - 50 percent READ, 50 percent WRITE, 50 percent cache hits for READ.Lotus Connections, Microsoft Sharepoint, and many other [social networking] usage are more write intensive.

  • Database (70/30/50) - 70 percent READ, 30 percent WRITE, 50 percent cache hits for READ.The traditional workload characteristics for most business applications, especially databases like DB2 andOracle on Linux, UNIX and Windows servers.

The results were quite impressive. There was more than enough performance for tier 2 application workloads,and most tier 1 applications. The performance was nearly linear from the smallest 6-module to the largest 15-module configuration. Some key points:

  • A full 15-module XIV overwhelms a single SVC 8F4 node-pair. For a full XIV, consider 4 to 8 nodes 8F4 models, or 2 to 4 nodes of an 8G4. For read-intensive cache-friendly workloads, an SVC in front of XIV was able to deliver over 300,000 IOPS.

  • A single node TS7650G ProtecTIER can handle 6 to 9 XIV modules. Two nodes of TS7650G were needed to drivea full 15-module XIV. A single node TS7650 in front of XIV was able to ingest 680 MB/sec on the seventh day with17 percent per-day change rate test workload using 64 virtual drives. Reading the data back got over 950 MB/sec.

  • For SAP environments where response time 20-30 msec are acceptable, the 15-module XIV delivered over 60,000 IOPS. Reducing this down to 25,000-30,000 cut the msec response time to a faster 10-15 msec.

These were all done as internal lab tests. Your mileage may vary.

Not surprisingly, XIV was quite the popular topic here this week at the Storage Symposium. There were many moresessions, but these were the only two that I attended.

technorati tags: IBM, XIV, SATA, best practices, performance, Wilson Kipketer, massive parallelism, HBA, DBMS, Oracle, ASM, DB2, SVC, VMware, VMFS, TSM, Tivoli, SAP, Quicksizer, SAPS, PERFMON, iostat, Disk+Magic, TS7650G, ProtecTIER

[Read More]

Tags:  disk tape

Storage Symposium 2009 - Day4 SVC Questions Answered

| | Comments (4) | Visits (14559)
IBM Symposium

Continuing my week in Chicago, for the IBM Storage Symposium 2008, we had sessions that focused on individual products. IBM System Storage SAN Volume Controller (SVC) was a popular topic.

SVC - Everything you wanted to know, but were afraid to ask!

Bill Wiegand, IBM ATS, who has been working with SAN Volume Controller since it was first introduced in 2003. answered some frequently asked questions about IBM System Storage SAN Volume Controller.

  1. Do you have to upgrade all of your HBAs, switches and disk arrays to the recommended firmware levels before upgrading SVC? No. These are recommended levels, but not required. If you do plan to update firmware levels, focus on the host end first, switches next, and disk arrays last.
  2. How do we request special support for stuff not yet listed on the Interop Matrix? Submit an RPQ/SCORE, same as for any other IBM hardware.
  3. How do we sign up for SVC hints and tips? Go to the IBM [SVC Support Site] and select the "My Notifications" under the "Stay Informed" box on the right panel.
  4. When we call IBM for SVC support, do we select "Hardware" or "Software"? While the SVC is a piece of hardware, there are very few mechanical parts involved. Unless there are sparks, smoke, or front bezel buttons dangling from springs, select "Software". Most of the questions are related to the software components of SVC.
  5. When we have SVC virtualizing non-IBM disk arrays, who should we call first? IBM has world-renown service, with some of IT's smartest people working the queues. All of the major storage vendors play nice as part of the [TSAnet Agreement when a mutual customer is impacted. When in doubt, call IBM first, and if necessary, IBM will contact other vendors on your behalf to resolve.
  6. What is the difference between livedump and a Full System Dump? Most problems can be resolved with a livedump. While not complete information, it is generally enough, and is completely non-disruptive. Other times, the full state of the machine is required, so a Full System Dump is requested. This involves rebooting one of the two nodes, so virtual disks may temporarily run slower on that I/O group.
  7. What does "svc_snap -c" do? The "svc_snap" command on the CLI generates a snap file, which includes the cluster error log and trace files from all nodes. The "-c" parameter includes the configuration and virtual-to-physical mapping that can be useful for disaster recovery and problem determination.
  8. I just sent IBM a check to upgrade my TB-based license on my SVC, how long should I wait for IBM to send me a software license key? IBM trusts its clients. No software license key will be sent. Once the check clears, you are good to go.
  9. During migration from old disk arrays to new disk arrays, I will temporarily have 79TB more disk under SVC management, do I need to get a temporary TB-based license upgrade during the brief migration period? Nope. Again, we trust you. However, if you are concerned about this at all, contact IBM and they will print out a nice "Conformance Letter" in case you need to show your boss.
  10. How should I maintain my Windows-based SVC Master Console or SSPC server? Treat this like any other Windows-based server in your shop, install Microsoft-recommended Windows updates, run Anti-virus scans, and so on.
  11. Where can I find useful "How To" information on SVC? Specify "SAN Volume Controller" in the search field of the [IBM Redbooks vast library of helpful books.
  12. I just added more managed disks to my managed disk group (MDG), can I get help writing a script to redistribute the extents to improve wide-striping performance? Yes, IBM has scripting tools available for download on [AlphaWorks]. For example, svctools will take the output of the "lsinfo" command, and generate the appropriate SVC CLI to re-migrate the disks around to optimize performance. Of course, if you prefer, you can use IBM Tivoli Storage Productivity Center instead for a more automated solution.
  13. Any rules of thumb for sizing SVC deployments? IBM's Disk Magic tool includes support for SVC deployments. Plan for 250 IOPS/TB for light workloads, 500 IOPS/TB for average workloads, and 750 IOPS/TB for heavy workloads.
  14. Can I migrate virtual disks from one manage disk group (MDG) to another of different extent size? Yes, the new Vdisk Mirroring capability can be used to do this. Create the mirror for your Vdisk between the two MDGs, wait for the copy to complete, and then split the mirror.
  15. Can I add or replace SVC nodes non-disruptively? Absolutely, see the Technotes [SVC Node Replacement page.

  16. Can I really order an SVC EE in Flamingo Pink? Yes. While my blog post that started all this [Pink It and Shrink It] was initially just some Photoshop humor, the IBM product manager for SVC accepted this color choice as an RPQ option. The default color remains Raven Black.

technorati tags: IBM, SVC, Audacity of Cope, svc_snap, Flamingo pink, Raven black, non-disruptive, svctools, AlphaWorks

[Read More]

Tags:  disk

Move to MyDeveloperWorks Now Complete

| | Comment (1) | Visits (7798)
Back in June, I mentioned this blog was [Moving to MyDeveloperWorks] which is based on IBM Lotus Connections. Finally, the move is complete for all bloggers. If you are having problems with the redirects, you might need to unsubscribe and re-subscribe in your RSS feed reader. Here are the new links for several IBM bloggers that have moved over:
  • [Inside System Storage - Tony Pearson]
  • [Storage Virtualization - Barry Whyte]
  • [Green Speed - Carlos Pratt]
  • [Benchmarking and Systems Performance - Elisabeth Stahl"]

Let me know what you think of the "XIV" color scheme of Black and Orange. I have not yet "tricked out" the template with all the latest bells and whistles, widgets and so on, that is still work to do.

technorati tags: IBM, MyDeveloperWorks, Barry Whyte, Carlos Pratt, Elisabeth Stahl, XIV





Tags:  blogging

Technorati Claim

| | Visits (4348)
ycfrwqjvub
  • Show:
  • 10
  • 20
  • 30
  • Previous
  • Next
1 2 3
Inside System Storage -- by Tony Pearson
  • Share
  • ?
  • Profiles ▼
  • Communities ▼
  • Apps ▼