Now Elastic Fabric Adapter Supported By AWS Batch

AWS Batch allows you to execute batch computing workloads on the AWS Cloud. AWS Batch is a cloud-native scheduler which handles instance provisioning and job scheduling. AWS Batch automatically provisions instances as per the job identification, with the proper placement group, networking configurations, and with any user-specified file system. Now, AWS Batch provides the potential to uncover host devices to your AWS Batch jobs, containing the Elastic Fabric Adapter (EFA), that allows you to execute highly performant distributed HPC and machine-learning workloads by using AWS Batch’s managed instance provisioning and scheduling. Elastic Fabric Adapter EFA is a network interface for Amazon EC2 instances which allows users to execute applications needing high levels of inter-node communications at scale on AWS. High Performance Computing (HPC) applications using the Message Passing Interface (MPI) and Machine Learning (ML) applications using NVIDIA Collective Communications Library (NCCL) can scale to thousands of CPUs or GPUs with the Elastic Fabric Adapter. As a result, you get the application performance of on-premises HPC clusters with the on-demand elasticity and flexibility of the AWS cloud. AWS Batch automatically sets up the EFA interconnect to the instances it starts, which the customer describes via one API parameter. To read further about Elastic Fabric Adapter and uncovering host devices to AWS Batch, refer documentation.

Now Elastic Fabric Adapter Is Commonly Accessible

Elastic Fabric Adapter EFA is a network interface for Amazon EC2 instances which allows users to execute High Performance Computing (HPC) applications needing high levels of inter-instance communications, like computational fluid dynamics, weather modeling, and reservoir simulation, at scale on AWS. It utilizes a custom-built operating system bypass method to improve the performance of inter-instance communications, which is important to scaling HPC applications. With EFA, HPC applications with the help of famous HPC technologies like Message Passing Interface (MPI) can scale to thousands of CPU cores. EFA gives assistance to industry-standard libfabric APIs, so applications which utilize a supported MPI library can be relocated to AWS with small or no change. Now, Elastic Fabric Adapter (EFA), a low-latency network adapter for Amazon EC2 Instances, is commonly accessible for production use. EFA was introduced as a preview in November 2018. This new feature EFA is accessible as an optional EC2 networking feature which you can enable on C5n.18xl and P3dn.24xl instances without any extra xharges. Now EFA is accessible in US East (Ohio), US East (N. Virginia), US West (Oregon), EU (Ireland), and AWS GovCloud (US). Assistance for extra instances and regions will be offered in the forth coming months. To know further on EFA for your HPC workloads, click here.