Tuesday, 26 September 2017

Apache Spark application history & YARN application status can now be viewed in the Amazon EMR console

The application history is available for up to 7 days; when it’s first complete and then updated throughout runtime. The application history will still be viewable even after the Amazon EMR cluster is terminated. The console will also include a list of currently active and completed YARN applications. For every Spark application, the granular information needs to be drilled down and then can be easily viewed in Amazon S3.The YARN application list, as well as the Spark application history, can be viewed on in the Cluster Details page through the Application History tab in the console supported on Amazon EMR release 5.8.0 or later. The application history in the console is available in all the supported regions for Amazon EMR except for GovCloud and Beijing.

No comments:

Post a Comment

Amazon Macie: Identifying Sensitive Information in S3 Objects

Amazon Macie: An Overview Amazon Macie is an AWS service designed to help detect sensitive information, such as Personally Identifiable Info...