Tuesday, 26 September 2017

Apache Spark application history & YARN application status can now be viewed in the Amazon EMR console

The application history is available for up to 7 days; when it’s first complete and then updated throughout runtime. The application history will still be viewable even after the Amazon EMR cluster is terminated. The console will also include a list of currently active and completed YARN applications. For every Spark application, the granular information needs to be drilled down and then can be easily viewed in Amazon S3.The YARN application list, as well as the Spark application history, can be viewed on in the Cluster Details page through the Application History tab in the console supported on Amazon EMR release 5.8.0 or later. The application history in the console is available in all the supported regions for Amazon EMR except for GovCloud and Beijing.

No comments:

Post a Comment

AI-Driven Cloud Optimization: Automated Cloud Optimization Reducing Waste and Maximizing Efficiency

In the dynamic landscape of cloud computing, businesses continually face the challenge of balancing performance and costs. As cloud infrastr...