Thursday, 12 July 2018

Application Auto Scaling can be used to scale any service that is created on the AWS Cloud and see how Netflix leverages it

Amazon Auto Scaling

Any services that you build on the AWS Cloud Environment can be scaled using Application Auto Scaling. Now with the new update, Netflix has adopted this new feature for their Video Streaming Company.

Netflix for past 3 years was investing in the container management platform (Titus) technology which has now become open source in 2018. Titus schedules application containers that have to be run over a fleet of thousands of Amazon Elastic Cloud Compute instances.  

Netflix developer team was focusing on the simple batch applications and workloads that have less availability requirement and features, but as the internal teams were building microservices they wanted to adopt container so they started creating scheduling support for server applications. But as Auto Scaling was the primary usage and saw the benefits of these services they wanted to leverage the containers and Titus, but the lack of auto-scaling feature they were finding difficulty in adopting.

Andrew Leung and Amit Joshi, Netflix Titus team wrote on The Netflix Tech Blog that they were planning to build their own solution and as they were already integrated with the AWS Auto Scaling team they took the chance and strongly described their use case. This led to the design of the new AWS Application Auto Scaling feature that even scales services that are outside of the AWS System. They used different AWS Services to successfully launch AWS Auto Scaling Service to the Titus Container Management Platform. Netflix just recently announced about this development so this means that they were earlier using the Application Auto Scaling AWS Feature privately.

Amazon Auto Scaling feature has improved Titus availability by making it capable of performing fast, online capacity adjustments. The auto-scaling feature has made their services more powerful where most of the services interact with the Netflix customers. Titus was able to configure the Scaling policies because of the auto-scaling feature which is the same way that happened with the EC2 adoption. Instead of Using Container with the new Auto Scaling technology they rather chose to adopt well-tested auto-scaling technology that the tools and the users well understood. They planned to use AWS Technology and benefit from those services instead of building their own Titus features such as load balancing, security groups, and networking.

Titus is now happy to announce that AWS has made this feature available to all the  AWS customers as the custom resource scaling. The customers that build any services on the AWS Cloud with adjustable resource will be automatically scaled with the new Custom Resource Scaling feature introduced in the Application Auto Scaling. 

Apart from Container Management Platform customers can scale Big Data infrastructure or the databases with the AWS Auto Scaling.  This has proved that AWS aims at fulfilling the customer needs and they are ready to serve the biggest customers by building services that will leverage their business. 

No comments:

Post a Comment

This is how Netflix keep their AWS Cloud Credentials locked and secure

Earlier we had discussed as to how  Netflix use Application Auto Scaling service for their Video Streaming Company but now we wil...