Tuesday, 26 September 2017

Apache Spark application history & YARN application status can now be viewed in the Amazon EMR console

The application history is available for up to 7 days; when it’s first complete and then updated throughout runtime. The application history will still be viewable even after the Amazon EMR cluster is terminated. The console will also include a list of currently active and completed YARN applications. For every Spark application, the granular information needs to be drilled down and then can be easily viewed in Amazon S3.The YARN application list, as well as the Spark application history, can be viewed on in the Cluster Details page through the Application History tab in the console supported on Amazon EMR release 5.8.0 or later. The application history in the console is available in all the supported regions for Amazon EMR except for GovCloud and Beijing.

No comments:

Post a comment

Budget overruns? Try Amazon Database Migration Accelerator

Amazon Database Migration Accelerator (DMA) was launched on 24 June, 2020 by AWS. Initially, AWS offers DMA to customers who are migra...