5 Things you should know about the IBM Data Engine for Analytics Solution - Power Systems Edition
- The IBM Data Engine for Analytics is a customizable infrastructure solution with integrated software optimized for big data and analytics workloads.
- The IBM Data Engine is ideal for workloads such as Hadoop or Spark and provides flexible and adjustable storage and compute resources that are easy to deploy and align to specific line business requirements.
- This means you can move or add more storage and compute when and where it’s needed to address multiple workloads as requirements change and evolve. It provides an easy onramp for clients to lay the foundation for bringing different big data and analytics workloads together onto one infrastructure.
- Built on IBM Power Systems, the IBM Data Engine for Analytics fully integrates the innovative capabilities of IBM Elastic Storage Server, IBM Platform Computing and networking components with Linux on Power scale-out systems. Clients can add big data and analytics software such as IBM InfoSphere BigInsights for Hadoop and Spark based analytics, IBM InfoSphere Streams for high ingest streaming analytics, and IBM Watson Explorer analytical components for advanced Natural Language Processing of unstructured data.
- The deep integration and optimization of analytics workload performance on Power Systems enables businesses to reach unparalleled performance to deliver insights to the business faster.
The following are the features and benefits of the solution:
- Complete, pre-assembled and tested infrastructure with big data and analytics software preloaded.
- On-site services for fast configuration and data center integration.
- Intelligent cluster management and automation for effective deployment.
- Easily set-up and manage workloads for multiple tenants.
- Adjustable resource allocation to meet diverse line of business demands.
- Scalable and extendable as needs change and as the enterprise grows.
- Reliability without data duplication.
- Tailored big data and analytics optimizations.
- Lays the foundation for consolidating traditional data analytics with new workloads such as Hadoop and Spark.
For more information, refer to the following website:
The residency team encourages you to download and read the IBM PowerHA SystemMirror Standard Edition 7.1.1 for AIX Update Redbooks publication. This publication contains information, scenarios, and useful information that can help you compare the features in previous versions of PowerHA Standard Edition with the new release. Thus helping you plan with your clients upcoming upgrades, and new implementation opportunities.
Chapter 7 is a very special chapter because for the first time the residency team covers the Smart Assist for SAP in a implementation scenario. Chapter 7 couples with Appendix E to provide as much detail on how to implement SAP and PowerHA.
This IBM Redbooks publication contains the following table of contents:
Chapter 1. Introducing IBM PowerHA SystemMirror 7.1.1
Chapter 2. Cluster Aware AIX
Chapter 3. PowerHA 7.1.1 basic installation and configuration
Chapter 4. Cluster administration
Chapter 5. Smart Assists for PowerHA SystemMirror
Chapter 6. Migration scenarios
Chapter 7. IBM PowerHA SystemMirror Smart Assist for SAP
Chapter 8. Workload partition and PowerHA scenario
Appendix A. AIX upgrades and PowerHA SystemMirror 7.1.0
Appendix B. Configuring the PowerHA cluster by using clmgr
Appendix C. Creating the hardware environment by using command-line tools
Appendix D. Replacing the failed repository disk if any nodes are not joined to the cluster
Appendix E. IBM PowerHA SystemMirror Smart Assist for SAP accessories for Chapter 7
Appendix F. PowerHA and workload partition examples
This IBM Redbooks publication can be downloaded at the following website:
If you have any suggestions, comments, or any feedback, please let us know via this blog. The team that developed this Redbooks publication looks forward to receiving any feedback.
The IBM PowerHA 7.1.3 Service Pack 1 - fix pack 18.104.22.168 is now available. Refer to the following website:
1. SAP HA management
2. HyperSwap Active-Active or passive with Oracle RAC
3. Repository replacement related fixes
4. Miscellaneous fixes
The residency team invites you to download and read the latest IBM Power Systems Performance Guide: Implementing and Optimizing Redbooks publication. This IBM Redbooks publication addresses performance tuning topics to help leverage the virtualization strengths of the POWER® platform to solve clients’ system resource utilization challenges, and maximize system throughput and capacity. We examine the performance monitoring tools, utilities, documentation, and other resources available to help technical teams provide optimized business solutions and support for applications running on IBM POWER systems’ virtualized environments.
The book offers application performance examples deployed on IBM Power Systems utilizing performance monitoring tools to leverage the comprehensive set of POWER virtualization features: Logical Partitions (LPARs), micro-partitioning, active memory sharing, workload partitions, and more. We provide a well-defined and documented performance tuning model in a POWER system virtualized environment to help you plan a foundation for scaling, capacity, and optimization
This IBM Redbooks publication can be downloaded at the following website:
In 2013, we continue to address and expands system and operating system performance tuning topics. This publication provides significant input in multiple areas including system performance tuning (virtualized environment), operating system performance tuning, application tuning, among others. We advise to carefully take our scenarios and recommendations into consideration with careful planning (change windows) because every environment has it owns configuration and caveats.
We encourage comments, suggestions, and any questions you might have after reading this publication.
The residency team invites you to download and read the draft of the IBM PowerHA SystemMirror 7.1.2 Enterprise Edition for AIX Redbooks publication.
This publication delivers the following table of contents:
Part 1 - Introduction
Chapter 1. Concepts and overview of the IBM PowerHA SystemMirror 7.1.2 Enterprise Edition
Chapter 2. Differences between PowerHA Enterprise Edition 6.1 and 7.1.2
Chapter 3. Planning
Part 2. - Campus style disaster recovery (streched clusters)
Chapter 4. Implementing DS8800 HyperSwap
Chapter 5. Cross-site LVM mirroring with PowerHA Standard Edition
Part 3 - Extended disaster recovery (linked clusters)
Chapter 6. Configuring PowerHA SystemMirror Enterprise Edition linked clusters with SVC replication
Chapter 7. Configuring PowerHA SystemMirror Enterprise Edition with XIV replication
Part 4 - System administration, monitoring, maintenance, and management
Chapter 8. Migrating to PowerHA SystemMirror 7.1.2 Enterprise Edition
Chapter 9. PowerHA 7.1.2 Systems Director plug-in enhancements
Chapter 10. Cluster partition management
Part 5 - Appendices
Appendix A. Configuring PowerHA with IPv6
Appendix B. DNS change for the IBM Systems Director environment with PowerHA
In 2013, we continue providing our clients with additional reference documentation utilizing IBM PowerHA SystemMirror as the key to help our IBM Power Systems clients with high availability solutions for their enterprise applications. Comments, questions, and suggestions are welcome as we continue to promote the adoption of IBM PowerHA SystemMirror across our clients environments.
The nomination period for the IBM Cluster Health Check residency is still open. I encourage you to submit your nomination to this residency or send comments on any particular area you would like the residency team to research, implement, test, and document.
During the residency, the team will customize, test, check and verify the Cluster infrastructure configuration and document how to monitor the overall health check of the Cluster infrastructure to deliver clients cost-effective, highly scalable, and robust solutions. The residency team will test and document topics to provide infrastructure health checks, check the cluster configuration, verifying functionality of the common subsystems (nodes or servers, switch fabric, parallel filesystem, job management, problem areas, etc.).
To submit a nomination, use the online web nomination form:
For any suggestion, comment, feedback, please add your comments to this blog.
The residency team invites you to download and read the first IBM Redbooks publication on the IBM Parallel Environment (PE) Developer Edition.
This IBM Redbooks publication has the following table of contents:
Chapter 1. Introduction
Chapter 2. Component tour
Chapter 3. Scenarios
Chapter 4. Server installation
Chapter 5. Managing projects using the Eclipse and PTP framework
Chapter 6. Parallel Environment Developer Edition tools
Chapter 7. Application profiling and tuning
Appendix A. HPC Toolkit environment variables
This publication delivers information to our Technical Computing (High Performance Computing) clients how to leverage IBM Clustering technologies (IBM System x, IBM iDataPlex, IBM Power Systems). There are many technologies that were used during this project to implement the environment which included system management software such as xCAT, and parallel file system with IBM General Parallel File System (GPFS).
The residency team looks forward to reading your comments in this blog. If you have any questions, comments, or any topics for future residency projects on this subject, please add your comments.
This project will update the previous GPFS publication: Implementing the IBM General Parallel File System (GPFS) in a Cross Platform Environment, SG24-7844. Additional areas to explore and document are:
• GPFS as a part of IBM’s broader software-defined storage environments
• Review use cases and expand the breadth of applicability of GPFS beyond traditional HPC use cases – SAP HANA, DB2 BLU Acceleration, Hadoop Analytics, Object store for OpenStack, and so on.
• Document GPFS FPO as a part of the GPFS capability for Big Data (not covered in prior IBM RedBooks)
• Position the IBM Platform Computing cloud service for clients needing high-performance software-defined storage in the cloud
• Explain the synergy between GPFS and storage intensive IBM products: Platform Symphony, Platform LSF, Algo, DataStage (where GPFS is part of the big data references architecture), Optim, BigInsights, Streams, SPSS, and so on.
In addition to updating the GPFS publication, the residency team will explore and document the following topics:
o An overview of the Platform Computing Cloud Services
o MultiCluster technology is central to the cloud service since this is how hybrid clusters are deployed
o GPFS as an option in the cloud service and why it is valuable
o Comparative economics of deploying on-premise vs. in the cloud
For additional information including the link to the nomination form, refer to the following website:
The nomination period for the IBM PowerHA SystemMirror 7.1.x for AIX Best Practices and Reference Architectures is residency is still open. I encourage you to submit your nomination for consideration.
During this residency, the team will implement and test high availability scenarios to develop and document high availability best practices and reference architectures.
To submit a nomination, you must use the online web nomination form:
Over the past few months, two IBM Redbooks publications addressing IBM PowerHA SystemMirror have been published addressing different topics including planning, migration, and integration with other technologies. However, in 2013, we would like to develop content that would provide help to our clients implementing this high availability solution. Any topic that past residencies might have not address, or you have questions about it, we encourage you to comment in this blog.
I recently announced the opening for nominations for the Implementing an IBM High Performance Computing (HPC) Solution on POWER8 residency program. I encourage you to submit your nomination utilizing the link included at the bottom of this announcement.
For additional information about the IBM Power Systems in particular the POWER8 announcement, and to learn more about it, refer to the following website:
To read more about the residency objectives, and to also submit your nomination, please refer to the following website:
Recently the ITSO announced this residency to develop how to content to building and managing Linux clusters for Cloud computing, analytics, mobile, etc. The residency information can be found at:
The goal of this residency is to show that IBM's PowerLinux cluster solutions (hardware and software) deliver significant value to clients in need of cost-effective, highly scalable, and robust solutions for BigData, analytics, Clouds, etc.
This residency project compliments the recently announced IBM Platform Computing Solutions Reference Architectures and Best Practices, SG24-8169 publication which provides how to details on how to deploy solutions for technical computing highlighting IBM Platform Computing, IBM iDataPlex, and IBM GPFS. The draft can be found at:
Thus far, you have read a few of the IBM Redbooks discussing topics with IBM Platform Computing for managing cluster solutions showing integrated solutions such as IBM System x, IBM Storage, IBM GPFS and of course IBM Platform Computing offerings. Please let me know if there are any topics you would like team to deliver content in the upcoming residency project. Your feedback is valuable.
I am working brainstorming topics with my residency team about IBM PowerHA with focus on migration practices.
After evaluating the current documentation including: Installation guides (manuals) and available Redbooks, there is very good documentation on migration scenarios already available including combinations of operating systems and PowerHA versions.
I am asking the broader technical audience via my blog if there is anything outside of what is currently documented that you think might be useful to create content, and document it an IBM Redbooks.
Feedback would be greatly appreciate it.
The residency team invites you to download and read the Workload Optimized Systems: Tuning IBM POWER7 for Analytics Redbooks publication.
This publication addresses topics to help clients to take advantage of the virtualization strengths of the POWER platform to solve system resource utilization challenges and maximize system throughput and capacity while helping our clients set up environments to analyze large amounts of data.
This IBM Redbooks publication contains the following table of contents:
Chapter 1. Introducing analytics on IBM Power Systems
Chapter 2. Implementing Cognos on IBM Power Systems
Chapter 3. Implementing IBM SPSS on IBM Power Systems
Chapter 4. Preferred practices
There is greater focus to provide our clients with the systems, solutions, tools, and best practices to manage and extract information from large amount of data stored in their enterprise.
The residency team looks forward to reading your comments on this publication, and on the topic of analytics.
IBM GPFS - Are you Ready?
In this short video presentation at https://www.youtube.com/watch?v=y5ELxaZpo4Q
, Scott Fadden provides a brief overview of IBM GPFS. The GPFS parallel file system is currently being utilized across multiple industries worldwide to manage the growth of data. For more Information on the IBM GPFS, refer to the website:
Also, visit the IBM GPFS WIKI which contains the latest information regarding the solution, implementation, and technical information. The WIKI can be accessed at:
5 Things you should know about the IBM Software Defined Environment (SDE)
1. SDE helps enable your organization to deliver IT services in the most efficient and productive way possible.
2. SDE combines compute, network, management, and storage resources and optimizes these resources efficiently.
3. SDE is the next generation of agile and optimized information technology.
4. SDE embraces open industry standards to foster freedom of choice and to help protect investments.
5. SDE leverages IBM Platform Resource Scheduler derived from IBM Platform Computing for dynamic resource management.
For additional information about the IBM Software Defined Environment, and to learn more about it, refer to the following website: