News around the Linux on Power Community
rfolco 270004CUW7 Marcações:  power clusters biginsights rfolco linux powerlinux hadoop 4.818 Visualizações
By: Rafael Folco.
I recently have had the opportunity to work with the IBM InfoSphere BigInsights product on PowerLinux.
From these experiences, I created a wiki page which describes some hints and tips on setting up a cluster for BigInsights.
The BigInsights product provides for serious hadoop-based processing and is available on the PowerLinux base. If you have questions on taking advantage of BigInsights and hadoop on Power systems, ask a question on the PowerLinux message board!
AdalbertoMedeiros 270004S8GS Marcações:  hadoop bigdata adalbertomedeiros clusters powerlinux 5.326 Visualizações
By: Adalberto Medeiros.
For those who want to use Hadoop in a PowerLinux cluster to process large sets of data, this tutorial helps building the last Hadoop release from Community (1.0.3) and how to install it.
More information on Hadoop:
From the Apache web page, Hadoop is defined as "a framework that allows for the distributed processing of large data sets across clusters of computers using a simple programming model. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures."
HeatherCrognale 270000378J Marcações:  heathercrognale alphabetsoup xcat cloud clusters 5.361 Visualizações
Alphabet Soup: xCAT
By: Heather Crognale.
When you're ready to provision a system in your cloud or cluster, you can go through each step on your own, or you can use the xCAT: Extreme Cloud (or Cluster) Administration Toolkit.
The xCAT is a collection of tools, most of which are script-based, that you can use to build, configure, administer, and maintain Linux clusters. You can use xCAT on any cluster, but it works particularly well on high-performance clusters, horizontal-scaling clusters, and administrative clusters. The xCAT can be used with several operating systems (Red Hat Enterprise Linux, AIX, Microsoft Windows) and cluster management tools (like KVM and PowerVM).
Originally developed in 1999 at IBM, the xCAT is now open-source and is continually evolving with user input.