A Diskless Kafka® on S3, Offering 10x Cost Savings and Scaling in Seconds.

<div align="center"> <p align="center"> 📑&nbsp <a href="https://www.automq.com/docs/automq/what-is-automq/overview?utm_source=github_automq" target="_blank" ><b>Documentation</b></a>&nbsp&nbsp&nbsp 🔥&nbsp <a href="https://www.automq.com/docs/automq-cloud/getting-started/install-byoc-environment/aws/install-env-from-marketplace?utm_source=github_automq" target="_blank" ><b>Free trial of AutoMQ on AWS</b></a>&nbsp&nbsp&nbsp </p>

<a href="https://trendshift.io/repositories/9782" target="_blank"><img src="https://trendshift.io/api/badge/repositories/9782" alt="AutoMQ%2Fautomq | Trendshift" style="width: 250px; height: 55px;" width="250" height="55"/></a>

</div> <div align="center"> <img width="97%" alt="automq-solgan" src="https://github.com/user-attachments/assets/bdf6c5f5-7fe1-4004-8e15-54f1aa6bc32f" /> <a href="https://www.youtube.com/watch?v=IB8sh639Rsg" target="_blank"> <img alt="Grab" src="https://github.com/user-attachments/assets/01668da4-3916-4f49-97af-18f91b25f8c1" width="19%" /> </a> <a href="https://www.automq.com/customer" target="_blank"> <img alt="Avia" src="https://github.com/user-attachments/assets/d2845e1c-caf4-444a-93f0-97b13c9c8490" width="19%" /> </a> <a href="https://www.automq.com/customer" target="_blank"> <img alt="Tencent" src="https://github.com/user-attachments/assets/2bdd205f-38c1-4110-9af1-d4c782db3395" width="19%" /> </a> <a href="https://www.automq.com/customer" target="_blank"> <img alt="Honda" src="https://github.com/user-attachments/assets/ee65af29-8ee3-404b-bf81-a004fe0c327c" width="19%" /> </a> <a href="https://www.automq.com/customer" target="_blank"> <img alt="Trip" src="https://github.com/user-attachments/assets/0cb4ae63-6dc1-43dc-9416-625a08dca2e5" width="19%" /> </a> <a href="https://www.automq.com/customer" target="_blank"> <img alt="LG" src="https://github.com/user-attachments/assets/ed9e0f87-abc6-4552-977c-f342ecb105a0" width="19%" /> </a> <a href="https://www.automq.com/blog/jdcom-automq-cubefs-trillion-scale-kafka-messaging" target="_blank"> <img alt="JD" src="https://github.com/user-attachments/assets/a7a86d2c-66fa-4575-b181-6cf56a31f880" width="19%" /> </a> <a href="https://www.automq.com/blog/automq-help-geely-auto-solve-the-pain-points-of-kafka-elasticity-in-the-v2x-scenario" target="_blank"> <img alt="Geely" src="https://github.com/user-attachments/assets/d61f7c51-0d80-4290-a428-a941441c7ec9" width="19%" /> </a> <a href="https://www.automq.com/blog/dewu-builds-trillion-level-monitoring-system-based-on-automq" target="_blank"> <img alt="Poizon" src="https://github.com/user-attachments/assets/45f4c642-0495-4bcc-9224-d2c5c2b2f0d5" width="19%" /> </a> <a href="https://www.automq.com/customer" target="_blank"> <img alt="Bitkub" src="https://github.com/user-attachments/assets/3b95cd26-973d-4405-9d2c-289c5807bb39" width="19%" /> </a> <a href="https://www.automq.com/customer" target="_blank"> <img alt="PalmPay" src="https://github.com/user-attachments/assets/b22f70f5-7553-4283-ac20-f034868b0121" width="19%" /> </a> <a href="https://www.automq.com/blog/automq-vs-kafka-evaluation-and-comparison-by-little-red-book" target="_blank"> <img alt="RedNote" src="https://github.com/user-attachments/assets/4a62f1f3-e171-4d58-9d7e-ebabad6f8e23" width="19%" /> </a> <a href="https://www.automq.com/blog/xpeng-motors-reduces-costs-by-50-by-replacing-kafka-with-automq" target="_blank"> <img alt="XPENG" src="https://github.com/user-attachments/assets/8b32c484-a4bf-4793-80d0-f454da254337" width="19%" /> </a> <a href="https://www.automq.com/customer" target="_blank"> <img alt="OPPO" src="https://github.com/user-attachments/assets/2b6d3cf0-ae54-4073-bc06-c6623e31c6d0" width="19%" /> </a> <a href="https://www.automq.com/customer" target="_blank"> <img alt="BambuLab" src="https://github.com/user-attachments/assets/d09ded1b-3696-49ac-b38f-d02f9598b3bb" width="19%" /> </a> </div>

• Grab: Driving Efficiency with AutoMQ in DataStreaming Platform
• JD.com x AutoMQ x CubeFS: A Cost-Effective Journey
• Palmpay Uses AutoMQ to Replace Kafka, Optimizing Costs by 50%+
• AutoMQ help Geely Auto(Fortune Global 500) solve the pain points of Kafka elasticity in the V2X scenario
• How Asia’s Quora Zhihu uses AutoMQ to reduce Kafka cost and maintenance complexity
• XPENG Motors Reduces Costs by 50%+ by Replacing Kafka with AutoMQ
• Asia's GOAT, Poizon uses AutoMQ Kafka to build observability platform for massive data(30 GB/s)
• AutoMQ Helps CaoCao Mobility Address Kafka Scalability During Holidays

Prerequisites

Before running AutoMQ locally, please ensure:

• Docker version 20.x or later
• Docker Compose v2
• At least 4 GB RAM allocated to Docker
• Ports 9092 and 9000 are available on your system

[!Tip] Deploying a production-ready AutoMQ cluster is challenging. This Quick Start is only for evaluating AutoMQ features and is not suitable for production use. For production deployment best practices, please contact our community for support.

The docker/docker-compose.yaml file provides a simple single-node setup for quick evaluation and development:

curl -O https://raw.githubusercontent.com/AutoMQ/automq/refs/tags/1.5.5/docker/docker-compose.yaml && docker compose -f docker-compose.yaml up -d

This setup features a single AutoMQ node serving as both controller and broker, alongside MinIO for S3 storage. All services operate within a Docker bridge network called automq_net, allowing you to start a Kafka producer in this network to test AutoMQ:

docker run --network automq_net automqinc/automq:latest /bin/bash -c \
"/opt/automq/kafka/bin/kafka-producer-perf-test.sh --topic test-topic --num-records=1024000 --throughput 5120 --record-size 1024 \
--producer-props bootstrap.servers=server1:9092 linger.ms=100 batch.size=524288 buffer.memory=134217728 max.request.size=67108864"

After testing, you can destroy the setup with:

docker compose -f docker-compose.yaml down

The docker/docker-compose-cluster.yaml file offers a more complex setup with three AutoMQ nodes, ideal for testing AutoMQ's cluster features, and can be run in the same way.

There are more deployment options available:

• Deploy Multi-Nodes Test Cluster on Docker
• Deploy on Linux with 5 Nodes
• Deploy on Kubernetes
• [Try AutoMQ on AWS Marketplace (Two Weeks Free Trial)](https://docs.automq.com/automq-cloud/get