Tuesday, 26 September 2017

Apache Spark application history & YARN application status can now be viewed in the Amazon EMR console

The application history is available for up to 7 days; when it’s first complete and then updated throughout runtime. The application history will still be viewable even after the Amazon EMR cluster is terminated. The console will also include a list of currently active and completed YARN applications. For every Spark application, the granular information needs to be drilled down and then can be easily viewed in Amazon S3.The YARN application list, as well as the Spark application history, can be viewed on in the Cluster Details page through the Application History tab in the console supported on Amazon EMR release 5.8.0 or later. The application history in the console is available in all the supported regions for Amazon EMR except for GovCloud and Beijing.

No comments:

Post a Comment

AWS’s growth story

AWS’s growth story - numbers don't lie! AWS took 123 months, a little over 10 years, to grow to a $10 billion business. Then took only 2...