ECS vs. Fargate: What's the difference?
When discussing options to run Docker on AWS, I’m often asked about the differences between ECS and EKS or Kubernets. However, lately, a new question arises: What’s the difference between ECS and AWS Fargate? In this blog post, you get the answer. You also learn about the advantages and disadvantages of both options.
Do you prefer listening to a podcast episode over reading a blog post? Here you go!
To understand the difference, let’s divide the ECS service into two responsibilities:
- Managing the lifecycle and placement of tasks
- Running containers
First, ECS is responsible for managing the lifecycle and placement of tasks. A task is usually made of one or two containers that work together, e.g., an nginx container with a php-fpm container. You can ask ECS to start or stop a task, and it stores your intent. However, ECS does not run or execute your container. ECS only provides the control plane to manage tasks. So, who runs the containers?
To run containers, you have two options. You can use ECS container instances, or you can use Fargate. Both options work together with ECS. The following figure demonstrates the difference.
An ECS container instance is nothing more than an EC2 instance that runs the ECS Container Agent. The EC2 instance is owned and managed by you. The instance appears in the list of EC2 instances like any other EC2 instance. The ECS Container Agent regularly polls the ECS API if new containers need to be started or stopped. Usually, you run a cluster of container instances in an auto-scaling group. ECS is free of charge. You only pay for the EC2 instances. The downside is that you have to scale, monitor, patch, and secure the EC2 instances yourself. Especially the scaling is not easy because:
Staying ahead of the game with Amazon Web Services (AWS) is a challenge. Our weekly videos and online events provide independent insights into the world of cloud. Subscribe to cloudonaut plus to get access to our exclusive videos and online events.Subscribe now!
- There is no obvious metric to scale the cluster and no integration to scale when the task placement fails because of insufficient capacity.
- The auto-scaling group and ECS are not aware of each other, making task deployments very hard during cluster scale in or rolling updates via CloudFormation (Capacity Providers address this issue but are not ready for prime time yet).
- You have to scale down without killing running tasks, which is an even more significant challenge for long-lived tasks.
An ECS container instance can run on Linux or Windows. Unused CPU shares can be used by other containers if available.
AWS Fargate manages the task execution. No EC2 instances to manage anymore. You pay for running tasks. That’s it. As easy as it sounds.
Each task that runs in Fargate comes with a dedicated Elastic Network Interface (ENI) with a private IP address. All containers of the same task can communicate with each other via localhost. Inbound and outbound task communication goes through the ENI. A public IP address can be enabled as well.
|ECS container instance||Fargate|
|Host OS||Linux, Windows||Linux|
|Max Memory||26 TB||30 GB|
|CPU bursting||Linux: yes; Windows: no||no|
|Pricing||per running EC2 instance||per running task|
|Discounts||Reserved Instances, Savings Plans, Spot||Compute Savings Plans, Spot|
|EBS integration||hacky but possible 1||no|
|Networking options||multiple 2||ENI per task|
ECS or Fargate is not the right question to ask. The question is whether to use container instances or Fargate. What ECS calls a container instance is known as a worker node in Kubernetes/EKS.
We learned it the hard way. Scaling container instances is a challenge. That’s why we recommend using Fargate. Fargate is much easier to operate. Use it if possible (see networking, vCPU, memory, host OS, and EBS limitations).
Want to get started with AWS Fargate quickly? Check out our book and online seminar Rapid Docker on AWS.