Cloudera Data Platform Data Center with IBM 7.1.1 offers migration paths from earlier versions of Hortonworks Data Platform and Cloudera Enterprise Data Hub platforms, and provides improved stability, security, and performance; Cloudera Workload Experience Manager with IBM is now available on premises

IBM Japan Software Announcement JP20-0365
July 14, 2020

Table of contents
OverviewOverviewTechnical informationTechnical information
Key requirementsKey requirementsOrdering informationOrdering information
Planned availability datePlanned availability dateTerms and conditionsTerms and conditions
Program numberProgram numberPricesPrices
PublicationsPublications


Overview

Top rule

Cloudera Data Platform Data Center with IBM® enhancements

Cloudera Data Platform Data Center with IBM combines many of the capabilities of Cloudera Enterprise Data Hub and Hortonworks Data Platform, providing a robust data management and analytics platform for on-premises environments. In addition to several enhancements to administration, stability, security, and performance, this release offers a migration path from Hortonworks Data Platform 2.6.5 or Cloudera Enterprise Data Hub 5.13, 5.14, 5.15, or 5.16 to Cloudera Data Platform Data Center with IBM 7.1.1.

Version 7.1.1 of Cloudera Data Platform Data Center with IBM brings the following key updates:

  • Support for Cloudera Enterprise Data Hub to Cloudera Data Platform Data Center with IBM in-place upgrade from Cloudera Enterprise Data Hub 5.13, 5.14, 5.15, or 5.16 clusters to Cloudera Runtime 7.1 and upgrade from Cloudera Manager 5.13, 5.14, 5.15, or 5.16 to Cloudera Manager 7.1 in Cloudera Data Platform Data Center 7.1.
  • Support for Migration from Cloudera Enterprise Data Hub to Cloudera Data Platform Data Center with IBM upgrade is provided by Cloudera Manager Replication Manager which enables data copy from a Cloudera Enterprise Data Hub 5 or Cloudera Enterprise Data Hub 6 cluster to a Cloudera Runtime 7.1 cluster.
  • Support for Hortonworks Data Platform to Cloudera Data Platform Data Center with IBM in-place upgrade path consists of upgrading from Hortonworks Data Platform 2.6.5.x to Cloudera Runtime 7.1 by using Ambari and then migrating the management platform from Ambari to Cloudera Manager. AM2CM tool captures Hortonworks Data Platform Cluster's blueprint from Ambari and converts it to a Cloudera Manager deployment template that is deployed to Cloudera Manager 7.1 and activates the Cloudera Runtime 7.1 parcels.
  • Support for Sentry to Ranger Migration converts Sentry privileges into their equivalents within Ranger service policies. Tool also supports migration of Kafka policies from Sentry to Ranger.
  • Support for Navigator to Atlas Migration converts Navigator content from business metadata such as Tags, Custom properties (definitions and entity assignments), Managed metadata properties (definitions and entity assignments), Original and updated entity names and descriptions and technical metadata from Hive, Impala, Spark, Referenced HDFS/S3 to Atlas content.
  • Streams messaging. This capability is designed to help organizations to achieve a robust Kafka streaming experience, boost Kafka connectivity, and improve operational efficiency. It enables organizations to monitor and manage Kafka clusters. The Streams messaging function also provides business continuity with Streams Replication Manager and the capability to scale up messaging through the use of Schema Registry.

For a list of official Apache versions for Cloudera Data Platform Data Center with IBM 7.1.1, see the Cloudera Data Platform - Data Center 7.1.1 Release Guide.

Hortonworks DataFlow enhancements

Hortonworks DataFlow is an enterprise-ready open source streaming data platform that collects, curates, analyzes, and acts on data in the data center and cloud. Hortonworks DataFlow is powered by key open sourced projects, which include Apache NiFi, Apache Kafka, and Apache Storm. IBM has three offerings that are based on HDF: Cloudera Flow Management with IBM for Ambari, Cloudera Enterprise Stream Processing with IBM for Ambari, and Hortonworks DataFlow Enterprise Management Services.

Version 3.5.1 of Hortonworks DataFlow brings the following key updates:

  • Apache NiFi is upgraded from 1.9.0 to 1.11.4. New features and improvements in Apache NiFi include:
    • Parameters. The parameters are a new concept in NiFi that enables users to define parameter contexts that are attached to process groups so that any property (including sensitive properties and properties that do not support expression language) can be parameterized. This is particularly useful in continuous integration and continuous delivery (CI/CD) pipelines when deploying workflows across multiple environments. Parameters are designed to be used as replacements of the variables.
    • Predictive monitoring. NiFi has an internal analytics framework that can be enabled to predict back pressure occurrence when provided with the configured settings for threshold on a queue. It uses recent observations from a queue (either number of objects or content size over time) and calculates predictions based on a model to anticipate back pressure.
    • SQL reporting task. The QueryNiFiReportingTask enables users to run SQL queries against tables that contain information about Connection Status, Processor Status, Bulletins, Process Group Status, JVM Metrics, Provenance, and Connection Status Predictions. In combination with Site to Site, it can be particularly useful to define fine-grained monitoring capabilities simultaneously with running workflows.
  • Kafka is upgraded from 2.1.0 to 2.3.1.
  • Schema Registry is upgraded from 0.7.0 to 0.8.1.

For a list of official Apache versions for Hortonworks DataFlow V3.5.1, see the Hortonworks Docs DataFlow 3.5.1.1 Release Notes.

Workload Experience Manager

Cloudera Workload Experience Manager for IBM is a tool that provides insights to help you gain in-depth understanding of the workloads you send to clusters managed by Cloudera Manager. In addition, it provides information that can be used for troubleshooting failed jobs and optimizing slow jobs that run on those clusters. After a job ends, information about job execution is sent to Cloudera Workload Experience Manager with IBM with the Telemetry Publisher, a role in the Cloudera Manager Management Service.

Cloudera Workload Experience Manager with IBM uses the information to display metrics about the performance of a job. Additionally, Cloudera Workload Experience Manager with IBM compares the current run of a job to previous runs of the same job by creating baselines. You can use the knowledge gained from this information to identify and address abnormal or degraded performance or potential performance improvements.

Previously available as a cloud service, Workload XM is now available on-premises. For more information, see the Cloudera Workload Experience Manager documentation.

IBM clients can download these releases from Passport Advantage®.



Back to topBack to top

Key requirements

Top rule

For details, see the Software requirements section.



Back to topBack to top

Planned availability date

Top rule

July 14, 2020



Back to topBack to top

Accessibility by people with disabilities

Top rule

Accessibility Compliance Reports (previously known as a VPAT) containing details on accessibility compliance to standards, including the Worldwide Consortium Web Content Accessibility Guidelines, European Standard EN 301 349, and US Section 508, can be found on the IBM Accessibility Conformance Report Request website.



Back to topBack to top

Reference information

Top rule

For more information about Cloudera Data Platform Data Center with IBM, see Software Announcement JP20-0108, dated May 5, 2020.

For more information about Hortonworks DataFlow, see Software Announcement JP19-0114, dated October 22, 2019.



Back to topBack to top

Program number

Top rule

Program number VRM Program name
5737-M27 7.1.1 Cloudera Data Platform Data Center with IBM
5737-N18 7.1.1 Cloudera Data Platform Data Center with IBM E Flex
5737-I18 3.5.1 Hortonworks DataFlow
5737-N49 2.1.0 Cloudera Workload Experience Manager with IBM


Back to topBack to top

Offering Information

Top rule

Product information is available on the IBM Offering Information website.

More information is also available on the Passport Advantage and Passport Advantage Express® website.



Back to topBack to top

Publications

Top rule

None



Back to topBack to top

Technical information

Top rule

Specified operating environment

Software requirements

Cloudera Data Platform Data Center with IBM

For details, see the Cloudera Manager documentation.

Hortonworks DataFlow

For details, see Cloudera software requirements.

Cloudera Workload Experience Manager for IBM

For details, see the Cloudera documentation.

IBM Support

IBM Support is your gateway to technical support tools and resources that are designed to help you save time and simplify support. IBM Support can help you find answers to questions, download fixes, troubleshoot, submit and track problem cases, and build skills. Learn and stay informed about the transformation of IBM Support, including new tools, new processes, and new capabilities, by going to the IBM Support Insider.

Planning information

Packaging

This offering is delivered through the internet as an electronic download. There is no physical media.



Back to topBack to top

Ordering information

Top rule

For ordering information, consult your IBM representative or IBM Business Partner, or go to the Passport Advantage website.

These programs are only available through Passport Advantage. They are not available as shrinkwrap.

These products may only be sold directly by IBM or by IBM Business Partners.

To locate IBM Business Partners in your geography, see the Find a Business Partner page.


Passport Advantage

Cloudera Workload Experience Manager with IBM (5737-N49)

Part number description Part number
Cloudera Workload Experience Manager with IBM Virtual Server Committed Term License D28NTLL

Charge metric

The charge metrics for these licensed products can be found in the following License Information documents:

Program identifier License Information document title License Information document number
5737-M27 Cloudera Data Platform Data Center with IBM L-MBIS-BQ2U4F
5737-N18 Cloudera Data Platform Data Center with IBM E Flex L-MBIS-BQ2UAL
5737-I18 Hortonworks DataFlow L-MBIS-BQ2V7N
5737-N49 Cloudera Workload Experience Manager with IBM L-MBIS-BQ2VBG

Select your language of choice and scroll down to the Charge Metrics section. Follow-on releases, if any, may have updated terms. See the License Information documents website for more information.



Back to topBack to top

Terms and conditions

Top rule

The information provided in this announcement letter is for reference and convenience purposes only. The terms and conditions that govern any transaction with IBM are contained in the applicable contract documents such as the IBM International Program License Agreement, IBM International Passport Advantage Agreement, and the IBM Agreement for Acquisition of Software Maintenance.

This product is only available through Passport Advantage.

Licensing

IBM International Program License Agreement including the License Information document and Proof of Entitlement (PoE) govern your use of the program. PoEs are required for all authorized use. Part number products only, offered outside of Passport Advantage, where applicable, are license only and do not include Software Maintenance.

This software license includes Software Subscription and Support (also referred to as Software Maintenance).

Software Maintenance

Licenses under the IBM International Program License Agreement (IPLA) provide for support with ongoing access to releases and versions of the program. IBM includes one year of Software Subscription and Support (also referred to as Software Maintenance) with the initial license acquisition of each program acquired. The initial period of Software Subscription and Support can be extended by the purchase of a renewal option, if available. Two charges apply: a one-time license charge for use of the program and an annual renewable charge for the enhanced support that includes telephone assistance (voice support for defects during normal business hours), as well as access to updates, releases, and versions of the program as long as support is in effect.

License Information number

The following License Information documents apply to the offerings in this announcement:

Program identifier License Information document title License Information document number
5737-M27 Cloudera Data Platform Data Center with IBM L-MBIS-BQ2U4F
5737-N18 Cloudera Data Platform Data Center with IBM E Flex L-MBIS-BQ2UAL
5737-I18 Hortonworks DataFlow L-MBIS-BQ2V7N
5737-N49 Cloudera Workload Experience Manager with IBM L-MBIS-BQ2VBG

Follow-on releases, if any, may have updated terms. See the License Information documents website for more information.

Limited warranty applies

Yes

Limited warranty

IBM warrants that when the program is used in the specified operating environment, it will conform to its specifications. The warranty applies only to the unmodified portion of the program. IBM does not warrant uninterrupted or error-free operation of the program or that IBM will correct all program defects. You are responsible for the results obtained from the use of the program.

IBM provides you with access to IBM databases containing information about known program defects, defect corrections, restrictions, and bypasses at no additional charge. For further information, see the IBM Support Guide.

IBM will maintain this information for at least one year after the original licensee acquires the program (warranty period).

Program support

Subscription and Support includes telephone assistance, as well as access to updates, releases, and versions of the program as long as support is in effect. You will be notified of discontinuance of support with 12 months' notice.

Money-back guarantee

If for any reason you are dissatisfied with the program and you are the original licensee, you may obtain a refund of the amount you paid for it, if within 30 days of your invoice date you return the program and its PoE to the party from whom you obtained it. If you downloaded the program, you may contact the party from whom you acquired it for instructions on how to obtain the refund.

For clarification, note that (1) for programs acquired under the IBM International Passport Advantage offering, this term applies only to your first acquisition of the program and (2) for programs acquired under any of IBM's On/Off Capacity on Demand (On/Off CoD) software offerings, this term does not apply since these offerings apply to programs already acquired and in use by you.

Volume orders (IVO)

No

Passport Advantage applies

Yes, information is available on the Passport Advantage and Passport Advantage Express website.

Software Subscription and Support applies

Yes. Software Subscription and Support, also referred to as Software Maintenance, is included with licenses purchased through Passport Advantage and Passport Advantage Express. Product upgrades and Technical Support are provided by the Software Subscription and Support offering as described in the Agreements. Product upgrades provide the latest versions and releases to entitled software, and Technical Support provides voice and electronic access to IBM support organizations, worldwide.

IBM includes one year of Software Subscription and Support with each program license acquired. The initial period of Software Subscription and Support can be extended by the purchase of a renewal option, if available.

While your Software Subscription and Support is in effect, IBM provides you assistance for your routine, short duration installation and usage (how-to) questions, and code-related questions. IBM provides assistance by telephone and, if available, electronic access, only to your information systems (IS) technical support personnel during the normal business hours (published prime shift hours) of your IBM support center. (This assistance is not available to your users.) IBM provides Severity 1 assistance 24 hours a day, 7 days a week. For additional details, see the IBM Support Guide. Software Subscription and Support does not include assistance for the design and development of applications, your use of programs in other than their specified operating environment, or failures caused by products for which IBM is not responsible under the applicable agreements.

Unless specified otherwise in a written agreement with you, IBM does not provide support for third-party products that were not provided by IBM. Ensure that when contacting IBM for covered support, you follow problem determination and other instructions that IBM provides, including in the IBM Support Guide.

For additional information about the International Passport Advantage Agreement and the IBM International Passport Advantage Express Agreement, go to the Passport Advantage and Passport Advantage Express website.

Cloudera products adhere to the Cloudera software lifecycle policy. For software support lifecycle details, see the Software Support Lifecycle Policy website.

Variable charges apply

No

Educational allowance available

Not applicable.



Back to topBack to top

Statement of good security practices

Top rule

IT system security involves protecting systems and information through intrusion prevention, detection, and response to improper access from within and outside your enterprise. Improper access can result in information being altered, destroyed, or misappropriated or can result in misuse of your systems to attack others. Without a comprehensive approach to security, no IT system or product should be considered completely secure and no single product or security measure can be completely effective in preventing improper access. IBM systems and products are designed to be part of a regulatory compliant, comprehensive security approach, which will necessarily involve additional operational procedures, and may require other systems, products, or services to be most effective.

Important: IBM does not warrant that any systems, products, or services are immune from, or will make your enterprise immune from, the malicious or illegal conduct of any party.



Back to topBack to top

Prices

Top rule

For all local charges, contact your local IBM representative or IBM Business Partner.


Business Partner information

If you are an IBM Business Partner acquiring products from IBM, you may link to Passport Advantage Online for resellers where you can obtain Business Partner pricing information. An IBMid and password are required to access the IBM Passport Advantage or IBM PartnerWorld® website.


Passport Advantage

For Passport Advantage information and charges, contact your IBM representative or IBM Business Partner. Additional information is also available on the Passport Advantage and Passport Advantage Express website.

Trademarks

IBM, Passport Advantage, Express and PartnerWorld are registered trademarks of IBM Corporation in the United States, other countries, or both.

Other company, product, and service names may be trademarks or service marks of others.

Terms of use

IBM products and services which are announced and available in your country can be ordered under the applicable standard agreements, terms, conditions, and prices in effect at the time. IBM reserves the right to modify or withdraw this announcement at any time without notice. This announcement is provided for your information only. Additional terms of use are located at

Terms of use

For the most current information regarding IBM products, consult your IBM representative or reseller, or go to the IBM worldwide contacts page

IBM Japan