Google Cloud

Pub/Sub vs Kafka vs Kinesis: Streaming Messaging Comparison

2026-05-24
NicheeLab Editorial Team

A deep comparison of the 3 leading streaming messaging platforms — Google Pub/Sub / Apache Kafka / AWS Kinesis. We break down pricing, performance, and features along the serverless / self-managed / managed axis.

Headline Comparison

AspectPub/SubPub/Sub LiteKafka (MSK)Kinesis Data Streams
Managed model◎ Serverless○ Zonal△ Node mgmt◎ Shard mgmt
OrderingOrdering KeyPartitionPartitionShard + Partition Key
Push delivery
Pull delivery
Exactly-once○ (Pull only)○ (Trans API)
Throughput ceilingUnlimitedReserved capacityUnlimitedPer-shard (1000 msg/s)
Billing unit$40/TBReserved capacityNodes + storageShard-hours + data
SLA99.95%99.5%99.9%99.9%

Pricing Example (1 TB/month + 1M msg/month)

ServiceApprox. monthly cost
Pub/Sub~$40 (data only)
Pub/Sub Lite~$5-10 (depending on reserved capacity)
Kafka (MSK m5.large × 3)~$500
Kafka (Confluent Standard)~$1000+ (cluster cost)
Kinesis Data Streams (10 Shard)~$110 (shards) + $40 (1 TB data)

Feature Comparison

FeaturePub/SubKafkaKinesis
Message retention7 days (default)Unlimited (configurable)1 day (default) / up to 365 days
ReplaySnapshot / SeekOffset rewindSequence number rewind
Schema RegistryPub/Sub SchemasConfluent Schema RegistryGlue Schema Registry
Stream ProcessingDataflow / BeamKafka Streams / FlinkKinesis Data Analytics (Flink)
ConnectorsLimitedHundreds via Kafka ConnectFirehose / Lambda
Dead Letter◎ TopicCustomCustom

Push vs Pull

AspectPushPull
SupportPub/Sub onlyAll 3 services
Subscriber implementationJust an HTTPS endpointSDK + polling loop
ScalingAuto, serverlessBy subscriber count
Main use caseCloud Run / FunctionsCustom apps, Dataflow

Recommendations by Use Case

Use caseRecommendedWhy
Serverless + GCPPub/SubPush delivery + Eventarc
Large-scale streaming ETLPub/Sub + DataflowServerless + unified Beam model
Need the Kafka ecosystemPub/Sub Lite or ConfluentKafka-compatible
Multi-cloud + OSSKafka (Confluent)Runs on AWS / Azure / GCP
AWS integrationKinesisDirect Firehose / Lambda / S3 hookups
IoT with hundreds of millions of devicesPub/SubUnlimited scale
Long-term message retentionKafkaUnlimited retention

What Sets Pub/Sub Apart

  • Fully serverless (no capacity planning required)
  • Push delivery (straight to an HTTPS endpoint)
  • BigQuery Subscription (direct write, no Dataflow needed)
  • Cloud Storage Subscription (batched writes)
  • Eventarc integration with 90+ event sources
  • Pub/Sub Lite as a Kafka alternative

Pub/Sub vs Kafka vs Kinesis: which one should I choose?

Want serverless → Pub/Sub. OSS compatibility at scale → Kafka (Confluent / MSK). Deep AWS integration → Kinesis. Pub/Sub Lite is rapidly gaining traction as a Kafka alternative.

How does Pub/Sub Lite compare to Kafka?

Pub/Sub Lite is the cost-optimized variant designed as a Kafka alternative (~10x cheaper). It supports Kafka-compatible clients (Kafka Connect, etc.) but requires zone-level capacity reservation.

Which has the highest throughput?

Kafka is theoretically unlimited (just add nodes). Pub/Sub handles millions of msg/sec. Kinesis Data Streams is capped at 1000 msg/sec per shard.

How is ordering guaranteed?

Kafka guarantees order within a partition (same for Pub/Sub Lite). Pub/Sub uses an Ordering Key. Kinesis guarantees order via shard + partition key.

What about exactly-once delivery?

Pub/Sub supports it on Pull subscriptions with the exactly-once setting. Kafka uses the Transactional API. Kinesis requires dedup logic on the consumer side.

How does pricing work?

Pub/Sub charges $40/TB of ingested data. Pub/Sub Lite uses reserved capacity. Kafka (MSK) bills node-hours + storage. Kinesis charges shard-hours + ingest. At high volume, Kafka tends to be cheaper.

Do they all support a Schema Registry?

Yes, all three. Pub/Sub Schemas (Avro/Proto), Kafka Schema Registry (Confluent), and Kinesis uses Glue Schema Registry.

Is Push delivery unique to Pub/Sub?

Yes, it is a Pub/Sub differentiator. Kafka and Kinesis are pull-only. Push delivery is especially powerful as a front-end for Cloud Run / Cloud Functions.

Related articles - streaming comparisons

Pub/Sub 完全ガイド|料金・Push vs Pull・Ordering Key・Kafka 比較 (GCP)

Google Cloud Pub/Sub の全機能解説。Push vs Pull、Ordering Key、Exactly-once、Dead Letter、Schema Registry、Pub/Sub Lite、AWS SNS/SQS / Kafka 比較、料金体系を網羅。

GCP vs AWS ストレージ・DB 徹底比較|GCS/S3・BigQuery/Redshift・Spanner/DynamoDB (2026)

GCP と AWS のストレージ・データベースを徹底比較。Cloud Storage vs S3、BigQuery vs Redshift、Spanner vs DynamoDB / Aurora DSQL、Cloud SQL vs RDS、AlloyDB vs Aurora、Firestore vs DynamoDB、Bigtable vs DynamoDB を 2026 年最新版で網羅。

GCP vs AWS コンピュート徹底比較|EC2/GCE・GKE/EKS・Lambda/Cloud Run・料金 (2026)

GCP と AWS のコンピュートサービスを徹底比較。Compute Engine vs EC2、GKE vs EKS、Cloud Run vs Lambda、App Engine vs Elastic Beanstalk、GPU/TPU、Arm 系 (Axion vs Graviton)、料金体系・Sustained Use Discount を 2026 年最新版で網羅。

Gemini vs GPT-4 vs Claude vs Llama 徹底比較|LLM API 選び方・料金 (2026)

Google Gemini 2.0 / OpenAI GPT-4o / Anthropic Claude Opus 4 / Meta Llama 3.3 の徹底比較。性能 / コード / 推論 / マルチモーダル / 料金 / コンテキスト長 / GCP・AWS・Azure 経由利用を 2026 年最新版で網羅。

* All products are trademarks of their respective owners. Always check the official vendor pages for the latest pricing.

Check what you learned with practice questions

Practice with certification-focused question sets

Go to GCP Exam Prep
Author

NicheeLab Editorial Team

NicheeLab editorial team focused on data engineering and cloud certification learning. Content is structured around practical study needs and official exam domains.


Related articles
Google Cloud

Google Cloud Certification Roadmap (2026)

Choose your GCP certification path — Foundational, Associate...

Google Cloud

CDL Cloud Digital Leader: Complete Exam Guide (2026)

Pass the Cloud Digital Leader exam — cloud business value, G...

Google Cloud

GAIL Generative AI Leader: Complete Exam Guide (2026)

Pass the Generative AI Leader exam — Gemini, Vertex AI, Work...

Google Cloud

Vertex AI Fundamentals for GCP Certs (2026)

Vertex AI basics every cert candidate needs — Workbench, Pip...

Google Cloud

Associate Cloud Engineer (ACE): Complete Guide (2026)

Pass the Associate Cloud Engineer exam — Console, gcloud, pr...

Browse all Google Cloud articles (103)
© 2026 NicheeLab All rights reserved.