Antoine Saliba 310000QA7P Visits (5983)
Click here to view the entire IzODA installation and customization guide.
Apache Spark (FMID HSPK120)
Apache Spark is an open source technology that provides data processing capabilities at scale. It can query, analyze and manipulate large amounts of data by leveraging distributed computing. Apache Spark has been incorporated into IzODA to allow customers to run analytical and machine learning workloads directly on IBM Z, eliminating the need to move sensitive data off platform to be analyzed. By storing data in memory, Spark's execution engine allows for data retrieval and analysis to occur much faster compared to similar workloads running MapReduce. Its support of many programming APIs and libraries such as SQL, DataFrames, MLlib, GraphX, and Spark Streaming make it appealing for Data Scientists as a general purpose analytics framework.
Click here for additional information pertaining to Apache Spark on IBM Z.
• Spark v2.0.2 Python docu
Optimized Data Layer or Mainframe Data Service (MDS) (FMID HMDS120)
The Optimized Data Layer, also referred to as MDS, acts as a data abstraction layer that offers a common interface to many forms of z/OS data including DB2, VSAM, and SMF.
Click here for additional information pertaining to the Optimized Data Layer on IBM Z.
Anaconda (FMID HANA110)
Anaconda is IBM's latest offering in the data analytics space. It offers the Python language, the Python package manager conda, and an extensive amount of Python analytics packages in order to bring to Z the same data science tools the open source community enjoys. Where Spark's strength lies in its own libraries and the benefits of writing in Scala, Anaconda allows developers to install data analytics packages, create environments (workspaces) with these packages, and share them with other developers in an extremely streamlined manner. Other benefits of Anaconda include use of environments for version control and little configuration overhead. This component of the IzODA product is extremely powerful and will be very attractive to data scientists.
Click here for additional information pertaining to Anaconda on IBM Z.