ISE Blog

Reasons to Deploy in the Cloud: (Part 2) Scaling to Meet Demand

Welcome back to Reasons to Deploy in the Cloud! In this series of posts, I'm going to discuss some reasons for choosing a cloud platform. Last time I went over three basic rules to saving money with cloud architecture. You've done the calculations, and cloud makes sense for your use-case from a cost perspective, now let's talk about the power and importance of scalability.

load.jpgWhat is scaling?

A scalable cloud application utilizes the managed services of the Infrastructure as a Service (IaaS) platform to grow or shrink its resources based on demand.  The simplest scalable architecture is a load-balancer marshaling requests to a bank of virtual servers. The load balancer can trigger an alert at various traffic thresholds and add or reduce the number of servers as needed.  This design ensures that your app remains available and responsive no matter how much traffic your app is managing.

Why scale?

If your product goes viral, you may experience an unexpected swarm of visitors. Traditional deployments require more hardware, and people to configure and maintain infrastructure. While these assets are coming online your customers will experience delays, and slow sites cost you sales. Three months later when the buzz cools off, all that hardware goes on Craigslist for half the purchase price.  Well-crafted cloud-aware applications scale automatically based on traffic and load with little to no delay, meaning happier customers and more repeat business.

How do you scale?

There are four considerations to app scalability. 

  1. Serverless ArchitechtureMake your components as small as possible – A modular design scales more efficiently. When each component can be moved to one or more separate resources, scaling will be smoother and faster. Many small servers are often cheaper than a few large ones.
  2. Use load testing to define smart scaling thresholds – Nothing will stress your app like real-world traffic. However, during design and development, simulation of the kinds of workloads your systems will be dealing with help guide the timing and scope of scaling rules.
  3. Leverage the infrastructure – Serverless architectures, sharded storage, dynamic clusters, automatic load-balancing and streaming services are scalable services offered by IaaS providers because they work. It is always easier to scale using these technologies than to re-invent them, if you can.
  4. Scale regionally – Many IaaS providers offer a global network of resources. When possible, build your app to be aware at a local level.  There's no reason to spin up extra servers in Frankfurt when your traffic is closer to your Beijing data center.

Designing your app with these four guidelines in mind will help ensure smooth transitions between high and low-traffic times, and help keep your costs down during the life cycle of your product. 


Stay tuned for more “Reasons to Deploy in the Cloud” posts! Next in the series we'll discuss some of the powerful management tools that cloud offerings give you to monitor and adapt to your end users' patterns. 

Samuel Thurston, Software Engineer

Samuel Thurston, Software Engineer

Samuel Thurston is a Software Engineer and Cloud Practice Lead for ISE, architecting and implementing cloud solutions for enterprise clients. He enjoys running, yoga, and cooking, and is frequently found on the disc golf course.

Samuel Thurston, Software Engineer

Latest posts by Samuel Thurston, Software Engineer (see all)

What’s Wrong with Monoliths? Oct 25, 2018

FaaS: Function as a Service Sep 28, 2018

Networking is Hard Aug 23, 2018

Observability in Distributed Systems Jul 19, 2018

Hands-On With Amazon AWS DeepLens Jun 21, 2018