5 Things you should know about the IBM Data Engine for Analytics Solution - Power Systems Edition
- The IBM Data Engine for Analytics is a customizable infrastructure solution with integrated software optimized for big data and analytics workloads.
- The IBM Data Engine is ideal for workloads such as Hadoop or Spark and provides flexible and adjustable storage and compute resources that are easy to deploy and align to specific line business requirements.
- This means you can move or add more storage and compute when and where it’s needed to address multiple workloads as requirements change and evolve. It provides an easy onramp for clients to lay the foundation for bringing different big data and analytics workloads together onto one infrastructure.
- Built on IBM Power Systems, the IBM Data Engine for Analytics fully integrates the innovative capabilities of IBM Elastic Storage Server, IBM Platform Computing and networking components with Linux on Power scale-out systems. Clients can add big data and analytics software such as IBM InfoSphere BigInsights for Hadoop and Spark based analytics, IBM InfoSphere Streams for high ingest streaming analytics, and IBM Watson Explorer analytical components for advanced Natural Language Processing of unstructured data.
- The deep integration and optimization of analytics workload performance on Power Systems enables businesses to reach unparalleled performance to deliver insights to the business faster.
The following are the features and benefits of the solution:
- Complete, pre-assembled and tested infrastructure with big data and analytics software preloaded.
- On-site services for fast configuration and data center integration.
- Intelligent cluster management and automation for effective deployment.
- Easily set-up and manage workloads for multiple tenants.
- Adjustable resource allocation to meet diverse line of business demands.
- Scalable and extendable as needs change and as the enterprise grows.
- Reliability without data duplication.
- Tailored big data and analytics optimizations.
- Lays the foundation for consolidating traditional data analytics with new workloads such as Hadoop and Spark.
For more information, refer to the following website:
The IBM PowerHA 7.1.3 Service Pack 1 - fix pack 18.104.22.168 is now available. Refer to the following website:
1. SAP HA management
2. HyperSwap Active-Active or passive with Oracle RAC
3. Repository replacement related fixes
4. Miscellaneous fixes
5 things you should know about IBM Spectrum Scale (formerly GPFS)
Spectrum Scale now part of IBM Spectrum Storage family, part of IBM's $1 Billion investment in software defined storage.
Single global namespace across all data tiers, including flash and cloud (service on Softlayer).
Object storage with integration with Swift (will be better with 4.1.1 release, not sure you can say that in a blog).
Scalability to handle the massive, ever-growing amounts of data in the new CAMS world.
Open and flexible, available as software (on almost any hardware), as a bundled IBM solution, or as a service running on Softlayer.
The residency team encourages you to download and read the IBM PowerHA SystemMirror Standard Edition 7.1.1 for AIX Update Redbooks publication. This publication contains information, scenarios, and useful information that can help you compare the features in previous versions of PowerHA Standard Edition with the new release. Thus helping you plan with your clients upcoming upgrades, and new implementation opportunities.
Chapter 7 is a very special chapter because for the first time the residency team covers the Smart Assist for SAP in a implementation scenario. Chapter 7 couples with Appendix E to provide as much detail on how to implement SAP and PowerHA.
This IBM Redbooks publication contains the following table of contents:
Chapter 1. Introducing IBM PowerHA SystemMirror 7.1.1
Chapter 2. Cluster Aware AIX
Chapter 3. PowerHA 7.1.1 basic installation and configuration
Chapter 4. Cluster administration
Chapter 5. Smart Assists for PowerHA SystemMirror
Chapter 6. Migration scenarios
Chapter 7. IBM PowerHA SystemMirror Smart Assist for SAP
Chapter 8. Workload partition and PowerHA scenario
Appendix A. AIX upgrades and PowerHA SystemMirror 7.1.0
Appendix B. Configuring the PowerHA cluster by using clmgr
Appendix C. Creating the hardware environment by using command-line tools
Appendix D. Replacing the failed repository disk if any nodes are not joined to the cluster
Appendix E. IBM PowerHA SystemMirror Smart Assist for SAP accessories for Chapter 7
Appendix F. PowerHA and workload partition examples
This IBM Redbooks publication can be downloaded at the following website:
If you have any suggestions, comments, or any feedback, please let us know via this blog. The team that developed this Redbooks publication looks forward to receiving any feedback.
The residency team invites you to download and read the latest IBM Power Systems Performance Guide: Implementing and Optimizing Redbooks publication. This IBM Redbooks publication addresses performance tuning topics to help leverage the virtualization strengths of the POWER® platform to solve clients’ system resource utilization challenges, and maximize system throughput and capacity. We examine the performance monitoring tools, utilities, documentation, and other resources available to help technical teams provide optimized business solutions and support for applications running on IBM POWER systems’ virtualized environments.
The book offers application performance examples deployed on IBM Power Systems utilizing performance monitoring tools to leverage the comprehensive set of POWER virtualization features: Logical Partitions (LPARs), micro-partitioning, active memory sharing, workload partitions, and more. We provide a well-defined and documented performance tuning model in a POWER system virtualized environment to help you plan a foundation for scaling, capacity, and optimization
This IBM Redbooks publication can be downloaded at the following website:
In 2013, we continue to address and expands system and operating system performance tuning topics. This publication provides significant input in multiple areas including system performance tuning (virtualized environment), operating system performance tuning, application tuning, among others. We advise to carefully take our scenarios and recommendations into consideration with careful planning (change windows) because every environment has it owns configuration and caveats.
We encourage comments, suggestions, and any questions you might have after reading this publication.
The residency team invites you to download and read the draft of the IBM PowerHA SystemMirror 7.1.2 Enterprise Edition for AIX Redbooks publication.
This publication delivers the following table of contents:
Part 1 - Introduction
Chapter 1. Concepts and overview of the IBM PowerHA SystemMirror 7.1.2 Enterprise Edition
Chapter 2. Differences between PowerHA Enterprise Edition 6.1 and 7.1.2
Chapter 3. Planning
Part 2. - Campus style disaster recovery (streched clusters)
Chapter 4. Implementing DS8800 HyperSwap
Chapter 5. Cross-site LVM mirroring with PowerHA Standard Edition
Part 3 - Extended disaster recovery (linked clusters)
Chapter 6. Configuring PowerHA SystemMirror Enterprise Edition linked clusters with SVC replication
Chapter 7. Configuring PowerHA SystemMirror Enterprise Edition with XIV replication
Part 4 - System administration, monitoring, maintenance, and management
Chapter 8. Migrating to PowerHA SystemMirror 7.1.2 Enterprise Edition
Chapter 9. PowerHA 7.1.2 Systems Director plug-in enhancements
Chapter 10. Cluster partition management
Part 5 - Appendices
Appendix A. Configuring PowerHA with IPv6
Appendix B. DNS change for the IBM Systems Director environment with PowerHA
In 2013, we continue providing our clients with additional reference documentation utilizing IBM PowerHA SystemMirror as the key to help our IBM Power Systems clients with high availability solutions for their enterprise applications. Comments, questions, and suggestions are welcome as we continue to promote the adoption of IBM PowerHA SystemMirror across our clients environments.
The nomination period for the IBM Cluster Health Check residency is still open. I encourage you to submit your nomination to this residency or send comments on any particular area you would like the residency team to research, implement, test, and document.
During the residency, the team will customize, test, check and verify the Cluster infrastructure configuration and document how to monitor the overall health check of the Cluster infrastructure to deliver clients cost-effective, highly scalable, and robust solutions. The residency team will test and document topics to provide infrastructure health checks, check the cluster configuration, verifying functionality of the common subsystems (nodes or servers, switch fabric, parallel filesystem, job management, problem areas, etc.).
To submit a nomination, use the online web nomination form:
For any suggestion, comment, feedback, please add your comments to this blog.
This residency kicks off on May 6, 2013. The objective of this project is to highlight IBM Technical Computing Solutions as a flexible infrastructure for clients looking to reduce capital expenditure, reduce operational expenditures, energy optimization of resources, re-use the infrastructure, and get the most of their current and future hardware purchases to continue developing their business. Technical Computing is not just for High Performance Computing (HPC) clients, but for commercial clients who want to use the advantages of technical computing, for example, to analyze large quantity of data in their enterprise.
The residency team encourages you provide any comments on your opinion about IBM Technical Computing, any areas you might think can be studied during the residency, or any topic you would like to discuss with the team.
Keep an eye on this blog as the residency team continues to explore this area and the benefits IBM Technical Computing brings to the industry.
Announcing the IBM PowerHA SystemMirror for AIX 7.1.3
The IBM PowerHA SystemMirror for AIX Standard Edition is the IBM Power Systems data center solution that helps protect critical business applications from outages, planned or unplanned. PowerHA SystemMirror for AIX Enterprise Edition includes the Standard Edition plus advanced capabilities such as failover to back up resources at remote locations.
PowerHA SystemMirror for AIX 7.1.3 enhances and adds new capabilities, including the following key features:
1. HyperSwap for active-active two-site configurations
2. HyperSwap for single-node clusters
3. Support for clustering with unicast communications
4. Capability to dynamically modify the host name of a clustered node
5. Operator-managed manual failover policy for multisite linked clusters
6. Graphical Cluster Simulator
7. Enhanced and flexible high availability management support for SAP
Announcing the IBM ITSO POWER8 Technology and System Technical Deep Dive Workshops
The goal with this workshop is to bring to the technical communities the news on POWER 8. This class focuses on providing the attendees with valuable information on the new POWER architecture including the lastest virtualization features.
These workshops are designed for all IT professionals, including technical project managers, architects, systems programmers, systems designers and application developers who need to understand how to design and exploit the hardware and software infrastructure required to effectively run modern IBM System z and POWER8 solutions. All workshops are open to Clients, Business Partners, Independent Software Vendors (ISVs) and IBMers. These workshops are especially recommended if you plan to use the latest levels of technology that are available or recently announced.
For locations and the links to the registration for the IBM ITSO POWER8 Technology and System Technical Deep Dive, WRZ13G (1 day), follow this website:
This project will update the previous GPFS publication: Implementing the IBM General Parallel File System (GPFS) in a Cross Platform Environment, SG24-7844. Additional areas to explore and document are:
• GPFS as a part of IBM’s broader software-defined storage environments
• Review use cases and expand the breadth of applicability of GPFS beyond traditional HPC use cases – SAP HANA, DB2 BLU Acceleration, Hadoop Analytics, Object store for OpenStack, and so on.
• Document GPFS FPO as a part of the GPFS capability for Big Data (not covered in prior IBM RedBooks)
• Position the IBM Platform Computing cloud service for clients needing high-performance software-defined storage in the cloud
• Explain the synergy between GPFS and storage intensive IBM products: Platform Symphony, Platform LSF, Algo, DataStage (where GPFS is part of the big data references architecture), Optim, BigInsights, Streams, SPSS, and so on.
In addition to updating the GPFS publication, the residency team will explore and document the following topics:
o An overview of the Platform Computing Cloud Services
o MultiCluster technology is central to the cloud service since this is how hybrid clusters are deployed
o GPFS as an option in the cloud service and why it is valuable
o Comparative economics of deploying on-premise vs. in the cloud
For additional information including the link to the nomination form, refer to the following website:
IBM GPFS provides fast data access and simple, cost effective data management. IBM GPFS can help:
Remove data-related bottlenecks
Simplify data management at scale
Empower global collaboration
Manage the full data lifecycle cost effectively
Ensure end-to-end data availability, reliability, and integrity
The residency team invites you to download and read the first IBM Redbooks publication on the IBM Parallel Environment (PE) Developer Edition.
This IBM Redbooks publication has the following table of contents:
Chapter 1. Introduction
Chapter 2. Component tour
Chapter 3. Scenarios
Chapter 4. Server installation
Chapter 5. Managing projects using the Eclipse and PTP framework
Chapter 6. Parallel Environment Developer Edition tools
Chapter 7. Application profiling and tuning
Appendix A. HPC Toolkit environment variables
This publication delivers information to our Technical Computing (High Performance Computing) clients how to leverage IBM Clustering technologies (IBM System x, IBM iDataPlex, IBM Power Systems). There are many technologies that were used during this project to implement the environment which included system management software such as xCAT, and parallel file system with IBM General Parallel File System (GPFS).
The residency team looks forward to reading your comments in this blog. If you have any questions, comments, or any topics for future residency projects on this subject, please add your comments.
I recently announced the opening for nominations for the Implementing an IBM High Performance Computing (HPC) Solution on POWER8 residency program. I encourage you to submit your nomination utilizing the link included at the bottom of this announcement.
For additional information about the IBM Power Systems in particular the POWER8 announcement, and to learn more about it, refer to the following website:
To read more about the residency objectives, and to also submit your nomination, please refer to the following website:
I encourage anyone interested to participate in the IBM Platform Computing Solutions Reference Architecture and Best Practices to submit your nomination for consideration.
There are already multiple Redbooks publications, and a few RedPapers on different technical challenges which IBM Platform Computing is addressing via their solutions. If you have any suggestions for topics for this residency, do not hesitate on adding comments to this blog.
During the residency, the team will provide reference architectures and best practices for deploying the Platform Computing solutions. Moreover, the team will implement and test Platform Computing solutions software stack focusing on specific industry solutions (engineering, life sciences, financial services, business analytics, oli and gas) leveraging the comprehensive set of IBM System x rack servers, IBM BladeCenter, IBM General Parallel File System (GPFS). This IBM Redbooks publication will demonstrate and document that the combination of IBM's System x, IBM GPFS and IBM Platform Computing solutions deliver significant value to clients in need of cost-effective, highly scalable, and robust solutions. IBM depth of solutions can help the clients plan a foundation to face challenges in how to manage, maintain, enhance, provision computing environments to analyze, for example, the growing volumes of data within their organizations.
To submit a nomination, you must use the online web nomination form:http://www.redbooks.ibm.com/Residents.nsf/GetResidency?OpenAgent&ID=PW-3901-R01
The nomination period for the IBM PowerHA SystemMirror 7.1.x for AIX Best Practices and Reference Architectures is residency is still open. I encourage you to submit your nomination for consideration.
During this residency, the team will implement and test high availability scenarios to develop and document high availability best practices and reference architectures.
To submit a nomination, you must use the online web nomination form:
Over the past few months, two IBM Redbooks publications addressing IBM PowerHA SystemMirror have been published addressing different topics including planning, migration, and integration with other technologies. However, in 2013, we would like to develop content that would provide help to our clients implementing this high availability solution. Any topic that past residencies might have not address, or you have questions about it, we encourage you to comment in this blog.
Recently the ITSO announced this residency to develop how to content to building and managing Linux clusters for Cloud computing, analytics, mobile, etc. The residency information can be found at:
The goal of this residency is to show that IBM's PowerLinux cluster solutions (hardware and software) deliver significant value to clients in need of cost-effective, highly scalable, and robust solutions for BigData, analytics, Clouds, etc.
This residency project compliments the recently announced IBM Platform Computing Solutions Reference Architectures and Best Practices, SG24-8169 publication which provides how to details on how to deploy solutions for technical computing highlighting IBM Platform Computing, IBM iDataPlex, and IBM GPFS. The draft can be found at:
Thus far, you have read a few of the IBM Redbooks discussing topics with IBM Platform Computing for managing cluster solutions showing integrated solutions such as IBM System x, IBM Storage, IBM GPFS and of course IBM Platform Computing offerings. Please let me know if there are any topics you would like team to deliver content in the upcoming residency project. Your feedback is valuable.
5 Things you should know about the IBM Software Defined Environment (SDE)
1. SDE helps enable your organization to deliver IT services in the most efficient and productive way possible.
2. SDE combines compute, network, management, and storage resources and optimizes these resources efficiently.
3. SDE is the next generation of agile and optimized information technology.
4. SDE embraces open industry standards to foster freedom of choice and to help protect investments.
5. SDE leverages IBM Platform Resource Scheduler derived from IBM Platform Computing for dynamic resource management.
For additional information about the IBM Software Defined Environment, and to learn more about it, refer to the following website:
I am working brainstorming topics with my residency team about IBM PowerHA with focus on migration practices.
After evaluating the current documentation including: Installation guides (manuals) and available Redbooks, there is very good documentation on migration scenarios already available including combinations of operating systems and PowerHA versions.
I am asking the broader technical audience via my blog if there is anything outside of what is currently documented that you think might be useful to create content, and document it an IBM Redbooks.
Feedback would be greatly appreciate it.
Modified on by DinoQuintero
The IBM ITSO is very close to release the latest PowerHA publication: IBM PowerHA SystemMirror 7.1.3 for AIX Best Practices and Reference Architectures, SG24-8167. Keep an eye to the announcement of the draft publication which will provide topics on the latest PowerHA 7.1.3 features, migration scenarios, monitoring, etc.
I am also announcing the opening of the next PowerHA residency to continue developing content on best practices and in particular migration scenarios. Our intend for this project is to continue to develop technical content to help you manage your PowerHA environments and with your feedback provide you with the best technical guidelines to keep your environment highly available. The new residency announcement can be found at:
Feedback for the residency team in regards to the current IBM PowerHA publications available at the ibm.com/redbooks website or feedback regarding upcoming topics for the residency team are welcome.