IBM Platform Conductor for Spark

Connect. Learn. Try. Share.


IBM Platform Conductor for Spark addresses challenges that organizations face in deploying Apache Spark. These challenges include integrating Spark into existing environments, managing Spark lifecycles in the face of frequent updates to open-source Spark distributions, and managing numerous Spark deployments within the organization.

Platform Conductor for Spark is an end-to-end enterprise-grade multitenant solution for Apache Spark. It allows organizations to deploy Apache Spark efficiently and effectively, supporting multiple deployments of Spark, increasing performance and scale, and maximizing resource usage.


Benefits

Platform Conductor for Spark eliminates resource silos that are tied to multiple Apache Spark implementations, and provides the following additional benefits:

Platform Conductor for Spark supports Spark multitenancy, allowing you to run multiple instances of Spark, including different versions, in a shared environment. Different groups can run their own instances of Spark and it is not necessary for all Spark instances to be upgraded in lockstep.


Components

Apache Spark requires a separate resource manager and can interface with various distributed storage models. Platform Conductor for Spark addresses both of these requirements. It incorporates the EGO resource manager that lies at the heart of IBM® Platform™ Symphony a proven technology for granular and dynamic resource management. For storage management, it incorporates IBM Spectrum Scale FPO technology. Platform Conductor for Spark also includes a Spark distribution, making it a complete end-to-end solution for organizations looking to deploy Spark both for exploratory projects and in production environments.

Platform Conductor for Spark is available as part of an uber installation package, enabling you to leverage multiple product capabilities. The common installation enables you to install Platform Conductor for Spark along with IBM Platform Symphony and IBM Platform Application Service Controller. You can entitle each product as required to gain from different functionalities across the three products.

For more information, see IBM Application Service Controller and IBM Platform Symphony.

Join the Platform Conductor for Spark technical community to connect with other members and collaborate with experts by accessing blogs, forums, and wikis.


Download the open beta

rfe page


Collaborate

Read and contribute blogs on the IBM Platform Conductor for Spark blog Read and contribute best practices on the IBM Platform Conductor for Spark wiki Ask and respond to technical questions on the IBM Platform Conductor for Spark forums

Support Portal

  • Support image

    Easy, Fast, Smart. Your customized support experience.


Follow Platform Computing

Platform Conductor on Spark on Twitter  Platform Conductor on Spark on YouTube  Platform Conductor on Spark on Facebook  Platform Conductor on Spark on LinkedIn 
%%sidebarspace%%