IBM Z Platform for Apache Spark 1.1 offers an enterprise-grade platform to enable Apache Spark on IBM z/OS

IBM Asia Pacific Software Announcement AP22-0043
April 5, 2022

Table of contents
OverviewOverviewTechnical informationTechnical information
Key requirementsKey requirementsOrdering informationOrdering information
Planned availability datePlanned availability dateTerms and conditionsTerms and conditions
Program numberProgram numberPricesPrices
PublicationsPublicationsRegional availabilityRegional availability


At a glance

Top rule

IBM Z® Platform for Apache Spark offers an Apache Spark distribution of the open source, in-memory processing engine that is designed for big data. It provides organizations with IBM® z/OS® with the ability to combine the benefits of Apache Spark with the advantage of analyzing business-critical data in place, with no data movement.

Apache Spark benefits:

  • Streamline development. Developers and data scientists can use their existing expertise with programming languages, such as Scala, Python, and SQL, to speed time to market. With Apache Spark, there is no need to learn new languages.
  • Simplify data access. Apache Spark removes data access complexity, providing seamless access to enterprise data with familiar tools. Built-in machine learning and graph algorithm libraries make it easy to enable interactive queries and deliver fast responses.
  • Develop a wide range of algorithms. Apache Spark lets you develop and deploy all workloads, including machine learning, iterative, and batch, faster.
  • Accelerate analytics results. Apache Spark uses an in-memory approach for processing data to deliver results quickly.


Back to topBack to top

Overview

Top rule

The large volume and variety of data available today offers the possibility of seeing things in new ways. Value comes from data-driven insights, not data alone. Analytic algorithms can combine and extract insights from a wide range of data, from transactional systems and data on the mainframe, to customer data collected from mobile and social applications and data streaming in from the Internet of Things, and sensors to identify trends, model possible scenarios, and predict future results. These insights can provide business advantage by identifying emerging opportunities, improving the customer experience, enhancing operational efficiencies, reducing risks, and more.

Apache Spark is an open source engine that is built specifically to accelerate the time to insight from analytics by providing a full framework of capability for data science. It helps simplify algorithm development and accelerate analytics results. With Apache Spark, you can better extract value from data, conducting deeper analyses and delivering results faster, all while reducing the time and effort required for coding.

IBM Z Platform for Apache Spark offers an enterprise-grade platform to enable Apache Spark to work natively on z/OS. It includes Apache Spark open source capabilities consisting of the Apache Spark core, Spark SQL, Spark Streaming, Machine Learning Library (MLib), and Graphx. It can also provide optimized data abstraction and virtualization to enable efficient access to a broad set of structured or unstructured data sources through Spark APIs when paired with data management tools.



Back to topBack to top

Key requirements

Top rule

IBM Z Platform for Apache Spark requires an IBM Z server and the following:

  • z/OS V2.3, or later
  • IBM 64-bit SDK for z/OS, Java™ Technology Edition, Version 8 Refresh 6
  • Bourne Again Shell (bash) version 4.3.48, or later

For more details, see the Technical information section.



Back to topBack to top

Planned availability date

Top rule

June 10, 2022

Availability within a country is subject to local legal requirements.



Back to topBack to top

Accessibility by people with disabilities

Top rule

Accessibility Compliance Reports (previously known as a VPAT) containing details on accessibility compliance to standards, including the Worldwide Consortium Web Content Accessibility Guidelines, European Standard EN 301 349, and US Section 508, can be found on the IBM Accessibility Conformance Report Request website.



Back to topBack to top

Reference information

Top rule

For information about z/OS V2.5 and CD enhancements for z/OS V2.5, see:

  • Software Announcement AP22-0079, dated March 15, 2022
  • Software Announcement AP21-0381, dated November 23, 2021
  • Software Announcement AP21-0249, dated July 27, 2021
  • Software Announcement AP21-0051, dated March 2, 2021

For information about z/OS V2.4 and CD enhancements for z/OS V2.4, see:

  • Software Announcement AP21-0206, dated June 22, 2021
  • Software Announcement AP21-0094, dated March 16, 2021
  • Software Announcement AP20-0469, dated December 8, 2020
  • Software Announcement AP20-0455, dated October 13, 2020
  • Software Announcement AP20-0362, dated September 22, 2020
  • Software Announcement AP20-0211, dated June 16, 2020
  • Software Announcement AP20-0097, dated March 17, 2020
  • Software Announcement AP19-0199, dated December 10, 2019
  • Software Announcement AP19-0326, dated July 23, 2019
  • Software Announcement AP19-0011, dated February 26, 2019

For information about IBM z16, see AG22-0002, dated April 5, 2022.

For information about IBM z15™, see:

  • Hardware Announcement AG20-0056, dated August 4, 2020
  • Hardware Announcement AG20-0006, dated April 14, 2020
  • Hardware Announcement AG20-0013, dated January 14, 2020
  • Hardware Announcement AG19-0094, dated November 26, 2019
  • Hardware Announcement AG19-0032, dated September 12, 2019

For information about IBM z14® Model ZR1, see:

  • Hardware Announcement AG18-0074, dated October 2, 2018
  • Hardware Announcement AG18-0018, dated April 10, 2018

For information about IBM z14, see:

  • Hardware Announcement AG18-0074, dated October 2, 2018
  • Hardware Announcement AG17-0093, dated November 28, 2017
  • Hardware Announcement AG17-0044, dated July 17, 2017

For information about IBM z13®, see:

  • Hardware Announcement AG19-0045, dated May 7, 2019
  • Hardware Announcement AG19-0017, dated February 12, 2019
  • Hardware Announcement AG16-0058, dated June 7, 2016
  • Hardware Announcement AG15-0060, dated March 3, 2015
  • Hardware Announcement AG15-0001, dated January 14, 2015

For information about IBM z13s®, see:

  • Hardware Announcement AG16-0058, dated June 7, 2016
  • Hardware Announcement AG16-0002, dated February 16, 2016



Back to topBack to top

Program number

Top rule

Program number VRM Program name
5698-SPK 1.1.0 IBM Z Platform for Apache Spark
5698-SPS 1.1.0 IBM Z Platform for Apache Spark S&S

IBM Z Platform for Apache Spark

Program PID number Subscription and Support PID number
5698-SPK 5698-SPS


Back to topBack to top

Education support

Top rule

IBM training provides education to support many IBM offerings. Descriptions of courses for IT professionals and managers can be found on the IBM Training and Skills website.

Contact your IBM representative for course information.



Back to topBack to top

Offering Information

Top rule

Product information is available on the IBM Offering Information website.



Back to topBack to top

Publications

Top rule

The program documentation includes these publications:

Title Order number
IBM Z Platform for Apache Spark Program Directory GI13-5806
IBM Z Platform for Apache Spark License Information GI13-5807
IBM Z Platform for Apache Spark Installation and Customization Guide GI13-5809
IBM Z Platform for Apache Spark System Messages GI13-5808

Documentation about IBM Z Platform for Apache Spark is available in IBM Documentation beginning June 10, 2022.



Back to topBack to top

Services

Top rule

IBM Systems Lab Services

Systems Lab Services offers infrastructure services to help build hybrid cloud and enterprise IT solutions. From servers to storage systems and software, Systems Lab Services can help deploy the building blocks of a next-generation IT infrastructure to empower a client's business. Systems Lab Services consultants can perform infrastructure services for clients online or onsite, offering deep technical expertise, valuable tools, and successful methodologies. Systems Lab Services is designed to help clients solve business challenges, gain new skills, and apply best practices.

Systems Lab Services offers a wide range of infrastructure services for IBM Power® servers, IBM Storage systems, IBM Z, and IBM LinuxONE. Systems Lab Services has a global presence and can deploy experienced consultants online or onsite around the world.

For assistance, contact Systems Lab Services at ibmsls@us.ibm.com.

To learn more, see the IBM Systems Lab Services website.

IBM Consulting

As transformation continues across every industry, businesses need a single partner to map their enterprise-wide business strategy and technology infrastructure. IBM Consulting is the business partner to help accelerate change across an organization. IBM specialists can help businesses succeed through finding collaborative ways of working that forge connections across people, technologies, and partner ecosystems. IBM Consulting brings together the business expertise and an ecosystem of technologies that help solve some of the biggest problems faced by organizations. With methods that get results faster, an integrated approach that is grounded in an open and flexible hybrid cloud architecture, and incorporating technology from IBM Research® and IBM Watson® AI, IBM Consulting enables businesses to lead change with confidence and deliver continuous improvement across a business and its bottom line.

For additional information, see the IBM Consulting website.

IBM Technology Support Services (TSS)

Get preventive maintenance, onsite and remote support and gain actionable insights into critical business applications and IT systems. Speed developer innovation with support for over 240 open-source packages. Leverage powerful IBM analytics and AI-enabled tools to enable client teams to manage IT problems before they become emergencies.

TSS offers extensive IT maintenance and support services that cover more than one niche of a client's environment. TSS covers products from IBM and OEMs, including servers, storage, network, appliances, and software, to help clients ensure high availability across their data center and hybrid cloud environment.

For details on available services, see the Technology support for hybrid cloud environments website.

IBM Expert Labs

Expert Labs can help clients accelerate their projects and optimize value by leveraging their deep technical skills and knowledge. With more than 20 years of industry experience, these specialists know how to overcome the biggest challenges to deliver business results that can have an immediate impact.

Expert Labs' deep alignment with IBM product development allows for a strategic advantage as they are often the first in line to get access to new products, features, and early visibility into roadmaps. This connection with the development enables them to deliver First of a Kind implementations to address unique needs or expand a client's business with a flexible approach that works best for their organization.

For additional information, see the IBM Expert Labs website.

IBM Security® Expert Labs

With extensive consultative expertise on IBM Security software solutions, Security Expert Labs helps clients and partners modernize the security of their applications, data, and workforce. With an extensive portfolio of consulting and learning services, Security Expert Labs provides project-based and premier support service subscriptions.

These services can help clients deploy and integrate IBM Security software, extend their team resources, and help guide and accelerate successful hybrid cloud solutions, including critical strategies such as zero trust. Remote and on-premises software deployment assistance is available for IBM Cloud Pak® for Security, IBM Security QRadar®/QRoC, IBM Security SOAR/Resilient®, IBM i2®, IBM Security Verify, IBM Security Guardium®, and IBM Security MaaS360®.

For more information, contact Security Expert Labs at sel@us.ibm.com.

For additional information, see the IBM Security Expert Labs website.



Back to topBack to top

Technical information

Top rule

Specified operating environment

Hardware requirements

IBM Z Platform for Apache Spark requires one of the following IBM Z servers:

  • IBM z16
  • z15 Models T01 and T02
  • z14 Models M01-M05
  • z14 Model ZR1
  • z13®
  • z13s®
Software requirements

IBM Z Platform for Apache Spark requires the following:

  • z/OS V2.3, or later
  • 64-bit SDK for z/OS, Java Technology Edition, Version 8 Refresh 6
  • Bourne Again Shell (bash) version 4.3.48, or later
IBM Support

IBM Support is your gateway to technical support tools and resources that are designed to help you save time and simplify support. IBM Support can help you find answers to questions, download fixes, troubleshoot, submit and track problem cases, and build skills. Learn and stay informed about the transformation of IBM Support, including new tools, new processes, and new capabilities, by going to the IBM Support Insider.

Additional IBM support

IBM Client Engineering

Client Engineering is a framework for accelerating digital transformation. It helps you generate innovative ideas and equips you with the practices, technologies, and expertise to turn those ideas into business value in weeks. When you work with Client Engineering, you bring pain points into focus. You empower your team to take manageable risks, adopt leading technologies, speed up solution development, and measure the value of everything you do. Client Engineering has experts and services to address a broad array of use cases, including capabilities for business transformation, hybrid cloud, analytics and AI, infrastructure systems, security, and more. Contact Client Engineering at sysgarage@ibm.com.

Planning information

Packaging

This offering is delivered through the internet as an electronic download. There is no physical media.

Direct client support

Security, auditability, and control

The announced product uses the security and auditability features and functions of host hardware, host software, and application software.

The client is responsible for evaluation, selection, and implementation of security features, administrative procedures, and appropriate controls in application systems and communication facilities.



Back to topBack to top

Ordering information

Top rule

Consult your IBM representative or IBM Business Partner.

Charge metric

The charge metrics for this licensed program can be found in the following License Information documents:

Program number License Information document title License Information document number
5698-SPK IBM Z Platform for Apache Spark L-BMYR-CC4LFC

Select your language of choice and scroll down to the Charge Metrics section. Follow-on releases, if any, may have updated terms. See the License Information documents website for more information.

Basic license

To order, specify the program number and the appropriate license or charge option.

Program name and number: IBM Z Platform for Apache Spark (5698-SPK)

Entitlement identifier Description License option/Pricing metric
S018LNW IBM Z Platform for Apache Spark Basic One Time Charge, per install
    Multi-Version Measurement, No Charge
Orderable supply ID Language
S018LNX US English

IBM recommends internet delivery. However, if you still require physical media, you can choose DVD.

Program name and number: IBM Z Platform for Apache Spark Subscription and Support (S&S) (5698-SPS)

Entitlement identifier Description License option/Pricing metric
S018LP0 IBM Z Platform for Apache Spark S&S SW S&S, Basic Annual Support Charge, per install
    Decline SW S&S, No Charge
    Multi-Version Measurement, No Charge
Orderable supply ID Language
S018LP1 US English

Customized Offerings

Product deliverables are shipped only through CBPDO and ServerPac. These customized offerings are offered for internet delivery. For more details on Internet delivery, go to the Help section on the Shopz website.

IBM recommends internet delivery. However, if you still require physical media, you can choose DVD.

Many products can be ordered in ServerPac the month following their availability in CBPDO. z/OS can be ordered through CBPDO and ServerPac on the planned availability date. Many products will also be orderable in a ServerPac without also having to order the z/OS operating system or subsystem.

Shopz and CFSW will determine the eligibility based on product requisite checking. For more details on the ServerPac, go to the Help section on the Shopz website.

Production of software product orders will begin on the planned availability date.

  • CBPDO shipments will begin within 3 business days after the planned availability date.
  • ServerPac availability and shipments will begin within 3 - 4 weeks after the planned product availability date due to additional customization and data input verification.



Back to topBack to top

Terms and conditions

Top rule

The information provided in this announcement letter is for reference and convenience purposes only. The terms and conditions that govern any transaction with IBM are contained in the applicable contract documents such as the IBM International Program License Agreement, IBM International Passport Advantage® Agreement, and the IBM Agreement for Acquisition of Software Maintenance.

Licensing

IBM International Program License Agreement including the License Information document and Proof of Entitlement (PoE) govern your use of the program. PoEs are required for all authorized use.

Software Maintenance

The following agreement applies for Software Subscription and Support (Software Maintenance) and does not require client signatures:

  • IBM Agreement for Acquisition of Software Maintenance (Z125-6011)

These programs are licensed under the IBM International Program License Agreement (IPLA) and the associated Agreement for Acquisition of Software Maintenance, which provide for support with ongoing access to releases and versions of the program. These programs have a one-time license charge for use of the program and an annual renewable charge for the enhanced support that includes telephone assistance (voice support for defects during normal business hours), as well as access to updates, releases, and versions of the program as long as support is in effect.

License Information number

The following License Information document applies to the program in this announcement:

Program number License Information document title License Information document number
5698-SPK IBM Z Platform for Apache Spark L-BMYR-CC4LFC

Follow-on releases, if any, may have updated terms. See the License Information documents website for more information.

Limited warranty applies

Yes

Limited warranty

IBM warrants that when the program is used in the specified operating environment, it will conform to its specifications. The warranty applies only to the unmodified portion of the program. IBM does not warrant uninterrupted or error-free operation of the program or that IBM will correct all program defects. You are responsible for the results obtained from the use of the program.

IBM provides you with access to IBM databases containing information on known program defects, defect corrections, restrictions, and bypasses at no additional charge. For further information, see the IBM Support Guide.

IBM will maintain this information for at least one year after the original licensee acquires the program (warranty period).

Program technical support

Continuous delivery (CD) support

Technical support of a program product version or release will be available for a minimum of two years from the planned availability date, as long as your Subscription and Support is in effect.

This technical support allows you to obtain assistance (by telephone or electronic means) from IBM for product-specific, task-oriented questions regarding the installation and operation of the program product. Software Subscription and Support also provides you with access to versions, releases, and updates (CD releases, Long Term Support Releases or fixes) of the program.

You will be notified, through an announcement letter, of discontinuance of support with 12 months' notice.

If you require additional technical support from IBM, including an extension of support beyond the discontinuance date, contact your IBM representative or IBM Business Partner. This extension may be available for a fee.

For additional information on the CD support lifecycle policy, see the IBM Continuous Delivery Support Lifecycle Policy support model web page.

For additional information on the IBM Software Support Lifecycle Policies, see the Standard and enhanced IBM software support lifecycle policies website.

Money-back guarantee

If for any reason you are dissatisfied with the program and you are the original licensee, you may obtain a refund of the amount you paid for it, if within 30 days of your invoice date you return the program and its PoE to the party from whom you obtained it. If you downloaded the program, you may contact the party from whom you acquired it for instructions on how to obtain the refund.

For clarification, note that for programs acquired under any of IBM's On/Off Capacity on Demand (On/Off CoD) software offerings, this term does not apply since these offerings apply to programs already acquired and in use by you.

Volume orders (IVO)

No

Passport Advantage applies

No

Software Subscription and Support applies

Yes. During the Software Subscription and Support period, for the unmodified portion of a program, and to the extent problems can be recreated in the specified operating environment, IBM will provide the following:

  • Defect correction information, a restriction, or a bypass.
  • Program updates: Periodic releases of collections of code corrections, fixes, functional enhancements and new versions and releases to the program and documentation.
  • Technical assistance: A reasonable amount of remote assistance by telephone or electronically to address suspected program defects. Technical assistance is available from the IBM support center in the organization's geography.

Additional details regarding Technical Assistance, which includes IBM contact information, are provided in the IBM Support Guide.

Software Subscription and Support does not include assistance for:

  • The design and development of applications.
  • Your use of programs in other than their specified operating environment.
  • Failures caused by products for which IBM is not responsible under the IBM Agreement for Acquisition of Software Maintenance.

Software Subscription and Support is provided only if the program is within its support timeframe as specified in the Software Support Lifecycle policy for the program.

Variable charges apply

No

Educational allowance available

15% to qualified educational institution clients.



Back to topBack to top

Statement of good security practices

Top rule

IT system security involves protecting systems and information through intrusion prevention, detection, and response to improper access from within and outside your enterprise. Improper access can result in information being altered, destroyed, or misappropriated or can result in misuse of your systems to attack others. Without a comprehensive approach to security, no IT system or product should be considered completely secure and no single product or security measure can be completely effective in preventing improper access. IBM systems and products are designed to be part of a regulatory compliant, comprehensive security approach, which will necessarily involve additional operational procedures, and may require other systems, products, or services to be most effective.

Important: IBM does not warrant that any systems, products, or services are immune from, or will make your enterprise immune from, the malicious or illegal conduct of any party.



Back to topBack to top

Prices

Top rule

For all local charges, contact your IBM representative.

IBM Global Financing

IBM Global Financing offers competitive financing to credit-qualified clients to assist them in acquiring IT solutions. Offerings include financing for IT acquisition, including hardware, software, and services, from both IBM and other manufacturers or vendors. Offerings (for all client segments: small, medium, and large enterprise), rates, terms, and availability can vary by country. Contact your local IBM Global Financing organization or go to the IBM Global Financing website for more information.

IBM Global Financing offerings are provided through IBM Credit LLC in the United States, and other IBM subsidiaries and divisions worldwide to qualified commercial and government clients. Rates are based on a client's credit rating, financing terms, offering type, equipment type, and options, and may vary by country. Other restrictions may apply. Rates and offerings are subject to change, extension, or withdrawal without notice.

Financing from IBM Global Financing helps you preserve cash and credit lines, enables more technology acquisition within current budget limits, can help accelerate implementation of economically attractive new technologies, offers payment and term flexibility, and can help match project costs to projected benefits. Financing is available worldwide for credit-qualified clients.



Back to topBack to top

Regional availability

Top rule

Australia, Bangladesh, Bhutan, Brunei Darussalam, Cambodia, People's Republic of China, Christmas Island, Cocos (Keeling) Islands, Cook Islands, Fiji, Heard Island and McDonald Islands, Hong Kong, India, Indonesia, Kiribati, Republic of Korea, Lao People's Democratic Republic, Macao, Malaysia, Maldives, Mongolia, Myanmar, Nauru, Nepal, New Zealand, Niue, Norfolk Island, Papua New Guinea, Philippines, Samoa, Singapore, Solomon Islands, Sri Lanka, Taiwan, Thailand, Timor-Leste, Tokelau, Tonga, Tuvalu, and Vietnam

Trademarks

z15 is a trademark of IBM Corporation in the United States, other countries, or both.

IBM Z, IBM, z/OS, Power, Passport Advantage, IBM z14, IBM z13, IBM z13s, IBM Research, IBM Watson, IBM Security, IBM Cloud Pak, QRadar, Resilient, i2, Guardium, MaaS360, z13 and z13s are registered trademarks of IBM Corporation in the United States, other countries, or both.

Oracle and Java are trademarks of Oracle and/or its affiliates in the United States, other countries, or both.

Other company, product, and service names may be trademarks or service marks of others.

Terms of use

IBM products and services which are announced and available in your country can be ordered under the applicable standard agreements, terms, conditions, and prices in effect at the time. IBM reserves the right to modify or withdraw this announcement at any time without notice. This announcement is provided for your information only. Reference to other products in this announcement does not necessarily imply those products are announced, or intend to be announced, in your country. Additional terms of use are located at

Terms of use

For the most current information regarding IBM products, consult your IBM representative or reseller, or go to the IBM worldwide contacts page

IBM Directory of worldwide contacts