Amazon Kinesis Data Streams versus Amazon MSK
Learn how Amazon Kinesis Data Streams differs from Amazon MSK.
| Amazon Kinesis Data Streams | Amazon MSK | |
|---|---|---|
| Scaling | 1 MB or 1000 msg/sec per shard; up to 500 shards; you need to manually add/remove shards |
30 brokers per cluster; you need add/remove brokers and reassign partitions manually |
| Max. message size | 1 MB |
configurable (default 1 MB) |
| Persistence | up to 365 days |
forever (up to 16384 GiB per broker) |
| Replication | Multi-AZ |
Multi-AZ (optional) |
| Order guarantee | within a shard |
within a partition |
| Delivery guarantee | at least once |
|
| Pricing | per shard hour |
per broker hour + provisioned storage |
| Protocols | AWS Rest API |
|
| AWS Integrations | Lambda |
Lambda |
| License | AWS only |
open source (Apache Kafka) |
| Encryption at rest | yes |
yes |
| Encryption in transit | yes |
yes |
Further reading
- Amazon SQS Standard versus Amazon Kinesis Data Streams
- Amazon SQS Standard versus Amazon MSK
- Amazon SQS FIFO versus Amazon Kinesis Data Streams
- Amazon SQS FIFO versus Amazon MSK
- Amazon SNS Standard versus Amazon Kinesis Data Streams
- Amazon SNS Standard versus Amazon MSK
- Amazon SNS FIFO versus Amazon Kinesis Data Streams
- Amazon SNS FIFO versus Amazon MSK
- Amazon EventBridge (formerly CloudWatch Events) versus Amazon Kinesis Data Streams
- Amazon EventBridge (formerly CloudWatch Events) versus Amazon MSK
- Amazon Kinesis Data Streams versus Amazon MQ
- Amazon Kinesis Data Streams versus AWS IoT Core
- Amazon MSK versus Amazon MQ
- Amazon MSK versus AWS IoT Core