IBM® Analytics for Apache Spark for IBM Cloud is introducing the support for Apache Spark 2.1 to create algorithms that harness insights from complex data.
Apache Spark 2.1 will help significantly around structured streaming with added support for event time watermarks and Kafka 0.10. Apache Spark 2.1 also focused on increasing stability and usability in Spark SQL, SparkR, and the MLlib modules. For more details on Spark 2.1, see Spark Release 2.1.0.
We are happy to answer any questions related to IBM® Analytics for Apache Spark for IBM Cloud or the newer version of Apache Spark 2.1 and are reachable at sparksrv@us.ibm.com.