5 Things you should know about the IBM Data Engine for Analytics Solution - Power Systems Edition
- The IBM Data Engine for Analytics is a customizable infrastructure solution with integrated software optimized for big data and analytics workloads.
- The IBM Data Engine is ideal for workloads such as Hadoop or Spark and provides flexible and adjustable storage and compute resources that are easy to deploy and align to specific line business requirements.
- This means you can move or add more storage and compute when and where it’s needed to address multiple workloads as requirements change and evolve. It provides an easy onramp for clients to lay the foundation for bringing different big data and analytics workloads together onto one infrastructure.
- Built on IBM Power Systems, the IBM Data Engine for Analytics fully integrates the innovative capabilities of IBM Elastic Storage Server, IBM Platform Computing and networking components with Linux on Power scale-out systems. Clients can add big data and analytics software such as IBM InfoSphere BigInsights for Hadoop and Spark based analytics, IBM InfoSphere Streams for high ingest streaming analytics, and IBM Watson Explorer analytical components for advanced Natural Language Processing of unstructured data.
- The deep integration and optimization of analytics workload performance on Power Systems enables businesses to reach unparalleled performance to deliver insights to the business faster.
The following are the features and benefits of the solution:
- Complete, pre-assembled and tested infrastructure with big data and analytics software preloaded.
- On-site services for fast configuration and data center integration.
- Intelligent cluster management and automation for effective deployment.
- Easily set-up and manage workloads for multiple tenants.
- Adjustable resource allocation to meet diverse line of business demands.
- Scalable and extendable as needs change and as the enterprise grows.
- Reliability without data duplication.
- Tailored big data and analytics optimizations.
- Lays the foundation for consolidating traditional data analytics with new workloads such as Hadoop and Spark.
For more information, refer to the following website:
The IBM PowerHA 7.1.3 Service Pack 1 - fix pack 18.104.22.168 is now available. Refer to the following website:
1. SAP HA management
2. HyperSwap Active-Active or passive with Oracle RAC
3. Repository replacement related fixes
4. Miscellaneous fixes
5 things you should know about IBM Spectrum Scale (formerly GPFS)
Spectrum Scale now part of IBM Spectrum Storage family, part of IBM's $1 Billion investment in software defined storage.
Single global namespace across all data tiers, including flash and cloud (service on Softlayer).
Object storage with integration with Swift (will be better with 4.1.1 release, not sure you can say that in a blog).
Scalability to handle the massive, ever-growing amounts of data in the new CAMS world.
Open and flexible, available as software (on almost any hardware), as a bundled IBM solution, or as a service running on Softlayer.
The residency team encourages you to download and read the IBM PowerHA SystemMirror Standard Edition 7.1.1 for AIX Update Redbooks publication. This publication contains information, scenarios, and useful information that can help you compare the features in previous versions of PowerHA Standard Edition with the new release. Thus helping you plan with your clients upcoming upgrades, and new implementation opportunities.
Chapter 7 is a very special chapter because for the first time the residency team covers the Smart Assist for SAP in a implementation scenario. Chapter 7 couples with Appendix E to provide as much detail on how to implement SAP and PowerHA.
This IBM Redbooks publication contains the following table of contents:
Chapter 1. Introducing IBM PowerHA SystemMirror 7.1.1
Chapter 2. Cluster Aware AIX
Chapter 3. PowerHA 7.1.1 basic installation and configuration
Chapter 4. Cluster administration
Chapter 5. Smart Assists for PowerHA SystemMirror
Chapter 6. Migration scenarios
Chapter 7. IBM PowerHA SystemMirror Smart Assist for SAP
Chapter 8. Workload partition and PowerHA scenario
Appendix A. AIX upgrades and PowerHA SystemMirror 7.1.0
Appendix B. Configuring the PowerHA cluster by using clmgr
Appendix C. Creating the hardware environment by using command-line tools
Appendix D. Replacing the failed repository disk if any nodes are not joined to the cluster
Appendix E. IBM PowerHA SystemMirror Smart Assist for SAP accessories for Chapter 7
Appendix F. PowerHA and workload partition examples
This IBM Redbooks publication can be downloaded at the following website:
If you have any suggestions, comments, or any feedback, please let us know via this blog. The team that developed this Redbooks publication looks forward to receiving any feedback.
The residency team invites you to download and read the latest IBM Power Systems Performance Guide: Implementing and Optimizing Redbooks publication. This IBM Redbooks publication addresses performance tuning topics to help leverage the virtualization strengths of the POWER® platform to solve clients’ system resource utilization challenges, and maximize system throughput and capacity. We examine the performance monitoring tools, utilities, documentation, and other resources available to help technical teams provide optimized business solutions and support for applications running on IBM POWER systems’ virtualized environments.
The book offers application performance examples deployed on IBM Power Systems utilizing performance monitoring tools to leverage the comprehensive set of POWER virtualization features: Logical Partitions (LPARs), micro-partitioning, active memory sharing, workload partitions, and more. We provide a well-defined and documented performance tuning model in a POWER system virtualized environment to help you plan a foundation for scaling, capacity, and optimization
This IBM Redbooks publication can be downloaded at the following website:
In 2013, we continue to address and expands system and operating system performance tuning topics. This publication provides significant input in multiple areas including system performance tuning (virtualized environment), operating system performance tuning, application tuning, among others. We advise to carefully take our scenarios and recommendations into consideration with careful planning (change windows) because every environment has it owns configuration and caveats.
We encourage comments, suggestions, and any questions you might have after reading this publication.
IBM GPFS provides fast data access and simple, cost effective data management. IBM GPFS can help:
Remove data-related bottlenecks
Simplify data management at scale
Empower global collaboration
Manage the full data lifecycle cost effectively
Ensure end-to-end data availability, reliability, and integrity
5 Things to Know about the IBM Elastic Storage Server (ESS):
- The Elastic Storage Server (ESS) is built on IBM Spectrum Scale (formerly IBM GPFS) for Linux.
- The Elastic Storage Server solution combines the CPU and I/O capability of the IBM POWER8 architecture.
- The Elast Storage Server deploys the latest solid state (SSD), SAS and Nearline SAS drives.
- The Elastic Storage Server is equipped to manage the complete data lifecycle.
- The Elastic Storage Server solution is designed for a variety of workloads.
For more information, refer to the following website:
This residency kicks off on May 6, 2013. The objective of this project is to highlight IBM Technical Computing Solutions as a flexible infrastructure for clients looking to reduce capital expenditure, reduce operational expenditures, energy optimization of resources, re-use the infrastructure, and get the most of their current and future hardware purchases to continue developing their business. Technical Computing is not just for High Performance Computing (HPC) clients, but for commercial clients who want to use the advantages of technical computing, for example, to analyze large quantity of data in their enterprise.
The residency team encourages you provide any comments on your opinion about IBM Technical Computing, any areas you might think can be studied during the residency, or any topic you would like to discuss with the team.
Keep an eye on this blog as the residency team continues to explore this area and the benefits IBM Technical Computing brings to the industry.
The nomination period for the IBM Cluster Health Check residency is still open. I encourage you to submit your nomination to this residency or send comments on any particular area you would like the residency team to research, implement, test, and document.
During the residency, the team will customize, test, check and verify the Cluster infrastructure configuration and document how to monitor the overall health check of the Cluster infrastructure to deliver clients cost-effective, highly scalable, and robust solutions. The residency team will test and document topics to provide infrastructure health checks, check the cluster configuration, verifying functionality of the common subsystems (nodes or servers, switch fabric, parallel filesystem, job management, problem areas, etc.).
To submit a nomination, use the online web nomination form:
For any suggestion, comment, feedback, please add your comments to this blog.
The residency team invites you to download and read the draft of the IBM PowerHA SystemMirror 7.1.2 Enterprise Edition for AIX Redbooks publication.
This publication delivers the following table of contents:
Part 1 - Introduction
Chapter 1. Concepts and overview of the IBM PowerHA SystemMirror 7.1.2 Enterprise Edition
Chapter 2. Differences between PowerHA Enterprise Edition 6.1 and 7.1.2
Chapter 3. Planning
Part 2. - Campus style disaster recovery (streched clusters)
Chapter 4. Implementing DS8800 HyperSwap
Chapter 5. Cross-site LVM mirroring with PowerHA Standard Edition
Part 3 - Extended disaster recovery (linked clusters)
Chapter 6. Configuring PowerHA SystemMirror Enterprise Edition linked clusters with SVC replication
Chapter 7. Configuring PowerHA SystemMirror Enterprise Edition with XIV replication
Part 4 - System administration, monitoring, maintenance, and management
Chapter 8. Migrating to PowerHA SystemMirror 7.1.2 Enterprise Edition
Chapter 9. PowerHA 7.1.2 Systems Director plug-in enhancements
Chapter 10. Cluster partition management
Part 5 - Appendices
Appendix A. Configuring PowerHA with IPv6
Appendix B. DNS change for the IBM Systems Director environment with PowerHA
In 2013, we continue providing our clients with additional reference documentation utilizing IBM PowerHA SystemMirror as the key to help our IBM Power Systems clients with high availability solutions for their enterprise applications. Comments, questions, and suggestions are welcome as we continue to promote the adoption of IBM PowerHA SystemMirror across our clients environments.
Announcing the IBM PowerHA SystemMirror for AIX 7.1.3
The IBM PowerHA SystemMirror for AIX Standard Edition is the IBM Power Systems data center solution that helps protect critical business applications from outages, planned or unplanned. PowerHA SystemMirror for AIX Enterprise Edition includes the Standard Edition plus advanced capabilities such as failover to back up resources at remote locations.
PowerHA SystemMirror for AIX 7.1.3 enhances and adds new capabilities, including the following key features:
1. HyperSwap for active-active two-site configurations
2. HyperSwap for single-node clusters
3. Support for clustering with unicast communications
4. Capability to dynamically modify the host name of a clustered node
5. Operator-managed manual failover policy for multisite linked clusters
6. Graphical Cluster Simulator
7. Enhanced and flexible high availability management support for SAP
IBM GPFS - Are you Ready?
In this short video presentation at https://www.youtube.com/watch?v=y5ELxaZpo4Q
, Scott Fadden provides a brief overview of IBM GPFS. The GPFS parallel file system is currently being utilized across multiple industries worldwide to manage the growth of data. For more Information on the IBM GPFS, refer to the website:
Also, visit the IBM GPFS WIKI which contains the latest information regarding the solution, implementation, and technical information. The WIKI can be accessed at:
This project will update the previous GPFS publication: Implementing the IBM General Parallel File System (GPFS) in a Cross Platform Environment, SG24-7844. Additional areas to explore and document are:
• GPFS as a part of IBM’s broader software-defined storage environments
• Review use cases and expand the breadth of applicability of GPFS beyond traditional HPC use cases – SAP HANA, DB2 BLU Acceleration, Hadoop Analytics, Object store for OpenStack, and so on.
• Document GPFS FPO as a part of the GPFS capability for Big Data (not covered in prior IBM RedBooks)
• Position the IBM Platform Computing cloud service for clients needing high-performance software-defined storage in the cloud
• Explain the synergy between GPFS and storage intensive IBM products: Platform Symphony, Platform LSF, Algo, DataStage (where GPFS is part of the big data references architecture), Optim, BigInsights, Streams, SPSS, and so on.
In addition to updating the GPFS publication, the residency team will explore and document the following topics:
o An overview of the Platform Computing Cloud Services
o MultiCluster technology is central to the cloud service since this is how hybrid clusters are deployed
o GPFS as an option in the cloud service and why it is valuable
o Comparative economics of deploying on-premise vs. in the cloud
For additional information including the link to the nomination form, refer to the following website:
I am working brainstorming topics with my residency team about IBM PowerHA with focus on migration practices.
After evaluating the current documentation including: Installation guides (manuals) and available Redbooks, there is very good documentation on migration scenarios already available including combinations of operating systems and PowerHA versions.
I am asking the broader technical audience via my blog if there is anything outside of what is currently documented that you think might be useful to create content, and document it an IBM Redbooks.
Feedback would be greatly appreciate it.
I encourage anyone interested to participate in the IBM Platform Computing Solutions Reference Architecture and Best Practices to submit your nomination for consideration.
There are already multiple Redbooks publications, and a few RedPapers on different technical challenges which IBM Platform Computing is addressing via their solutions. If you have any suggestions for topics for this residency, do not hesitate on adding comments to this blog.
During the residency, the team will provide reference architectures and best practices for deploying the Platform Computing solutions. Moreover, the team will implement and test Platform Computing solutions software stack focusing on specific industry solutions (engineering, life sciences, financial services, business analytics, oli and gas) leveraging the comprehensive set of IBM System x rack servers, IBM BladeCenter, IBM General Parallel File System (GPFS). This IBM Redbooks publication will demonstrate and document that the combination of IBM's System x, IBM GPFS and IBM Platform Computing solutions deliver significant value to clients in need of cost-effective, highly scalable, and robust solutions. IBM depth of solutions can help the clients plan a foundation to face challenges in how to manage, maintain, enhance, provision computing environments to analyze, for example, the growing volumes of data within their organizations.
To submit a nomination, you must use the online web nomination form:http://www.redbooks.ibm.com/Residents.nsf/GetResidency?OpenAgent&ID=PW-3901-R01