Tuesday, 26 September 2017

Apache Spark application history & YARN application status can now be viewed in the Amazon EMR console

The application history is available for up to 7 days; when it’s first complete and then updated throughout runtime. The application history will still be viewable even after the Amazon EMR cluster is terminated. The console will also include a list of currently active and completed YARN applications. For every Spark application, the granular information needs to be drilled down and then can be easily viewed in Amazon S3.The YARN application list, as well as the Spark application history, can be viewed on in the Cluster Details page through the Application History tab in the console supported on Amazon EMR release 5.8.0 or later. The application history in the console is available in all the supported regions for Amazon EMR except for GovCloud and Beijing.

No comments:

Post a Comment

AWS CodePipeline Can Be Used To Deploy Files To Amazon S3

AWS CodePipeline is a completely managed continuous delivery service which assists you automate your release pipelines for rapid and ...