Saturday, 4 August 2018

Amazon EMR 5.16.0 version now adds support for Apache Livy 0.5.0 and Apache Flink 1.5.0

Amazon EMR new released version 5.16.0 now adds support for Apache Livy 0.5.0 and Apache Flink 1.5.0. The Apache Livy 0.5.0 has multiple improvements such as sharing variables on all jobs, support for SparkSQL interpreter for operating SQL queries, sharing SparkContext in a single session, utilization of multiple languages and several other improvements. Apache Flink 1.5.0 offers several features such support for deployment of new model for dynamic resource allocation for YARN, SQL CLI client to run ad-hoc queries on data streams, store state information on the hard disk for quick failure recovery, support for broadcast state that replicates patterns and configuration rules to all the parallel instances and several other improvements. Amazon EMR Cluster can be created with the release of 5.16.0 version by selecting release label “emr-5.16.0” from the AWS Management Console.

No comments:

Post a Comment

As cloud adoption grows, so do tech leadership roles

  Cloud's focus has evolved from lift-and-shift to supporting data-driven infrastructure. According to a recent Denodo survey, "IT ...