Saturday, 4 August 2018

Amazon EMR 5.16.0 version now adds support for Apache Livy 0.5.0 and Apache Flink 1.5.0

Amazon EMR new released version 5.16.0 now adds support for Apache Livy 0.5.0 and Apache Flink 1.5.0. The Apache Livy 0.5.0 has multiple improvements such as sharing variables on all jobs, support for SparkSQL interpreter for operating SQL queries, sharing SparkContext in a single session, utilization of multiple languages and several other improvements. Apache Flink 1.5.0 offers several features such support for deployment of new model for dynamic resource allocation for YARN, SQL CLI client to run ad-hoc queries on data streams, store state information on the hard disk for quick failure recovery, support for broadcast state that replicates patterns and configuration rules to all the parallel instances and several other improvements. Amazon EMR Cluster can be created with the release of 5.16.0 version by selecting release label “emr-5.16.0” from the AWS Management Console.

No comments:

Post a Comment

AWS Elemental MediaLive annexes Input Switching for Live Channels

AWS Elemental MediaLive is a broadcast-grade live video processing service. It allows you to make high-quality video streams for delivery...