SkillAgentSearch skills...

Addax

A fast and versatile ETL tool that can transfer data between RDBMS and NoSQL seamlessly

Install / Use

/learn @wgzhao/Addax
About this skill

Quality Score

0/100

Supported Platforms

Universal

README

<p align="center"> <img alt="Addax Logo" src="https://github.com/wgzhao/Addax/blob/master/images/logo.svg?raw=true" width="205" /> </p> <h1 align="center">Addax</h1> <p align="center"> <b>A versatile open-source ETL tool</b> </p> <p align="center"> Addax is an extensible ETL (Extract, Transform, Load) tool supporting over 20 SQL/NoSQL data sources, developed as a fork and evolution of Alibaba's <a href="https://github.com/alibaba/datax">DataX</a>. It provides a growing ecosystem of plugins and offers easy-to-follow configuration for data integrations. </p> <p align="center"> <a href="https://github.com/wgzhao/Addax/releases"> <img src="https://img.shields.io/github/release/wgzhao/addax.svg" alt="Release Version" /> </a> <a href="https://github.com/wgzhao/Addax/workflows/Maven%20Package/badge.svg"> <img src="https://github.com/wgzhao/Addax/workflows/Maven%20Package/badge.svg" alt="Maven Package" /> </a> </p>

简体中文


🚀 Features

  • Supports 20+ SQL and NoSQL data sources, and easily extendable for more.
  • Configurable via simple JSON-based job descriptions.
  • Actively maintained with improved architecture and added functionality compared to DataX.
  • Docker images for quick deployment.

📚 Documentation

Detailed instructions on installation, configuration, and usage are available:


📦 Supported Data Sources

Addax supports a wide range of database systems and file sources. Below is a selection of supported platforms:

<table> <tr> <td><img src="./images/logos/cassandra.svg" height="50px" alt="Cassandra" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/clickhouse.svg" height="50px" alt="Clickhouse" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/databend.svg" height="50px" alt="DataBend" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/db2.svg" height="50px" alt="IMB DB2" style="border: 1px solid #ddd;"></td> </tr> <tr> <td><img src="./images/logos/dbase.svg" height="50px" alt="dBase" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/doris.svg" height="50px" alt="Doris" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/elasticsearch.svg" height="50px" alt="Elasticsearch" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/excel.svg" height="50px" alt="Excel" style="border: 1px solid #ddd;"></td> </tr> <tr> <td><img src="./images/logos/greenplum.svg" height="50px" alt="Greenplum" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/hbase.svg" height="50px" alt="Apache HBase" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/hive.svg" height="50px" alt="Hive" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/influxdata.svg" height="50px" alt="InfluxDB" style="border: 1px solid #ddd;"></td> </tr> <tr> <td><img src="./images/logos/kafka.svg" height="50px" alt="Kafka" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/kudu.svg" height="50px" alt="Kudu" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/minio.svg" height="50px" alt="MinIO" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/mongodb.svg" height="50px" alt="MongoDB" style="border: 1px solid #ddd;"></td> </tr> <tr> <td><img src="./images/logos/mysql.svg" height="50px" alt="MySQL" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/oracle.svg" height="50px" alt="Oracle" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/phoenix.svg" height="50px" alt="Phoenix" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/postgresql.svg" height="50px" alt="PostgreSQL" style="border: 1px solid #ddd;"></td> </tr> <tr> <td><img src="./images/logos/presto.svg" height="50px" alt="Presto" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/redis.svg" height="50px" alt="Redis" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/s3.svg" height="50px" alt="Amazon S3" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/sqlite.svg" height="50px" alt="SQLite" style="border: 1px solid #ddd;"></td> </tr> <tr> <td><img src="./images/logos/sqlserver.svg" height="50px" alt="SQLServer" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/starrocks.svg" height="50px" alt="Starrocks" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/sybase.svg" height="50px" alt="Sybase" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/tdengine.svg" height="50px" alt="TDengine" style="border: 1px solid #ddd;"></td> </tr> <tr> <td><img src="./images/logos/trino.svg" height="50px" alt="Trino" style="border: 1px solid #ddd;"></td> <td><img src="./images/logos/access.svg" height="50px" alt="Access" style="border: 1px solid #add;"></td> <td><img src="./images/logos/sap.svg" height="50px" alt="SAP HANA" style="border: 1px solid #add;"></td> <td><img src="./images/logos/paimon.svg" height="50px" alt="Paimon" style="border: 1px solid #add;"></td> </tr> <tr> <td><img src="./images/logos/iceberg.svg" height="50px" alt="Iceberg" style="border: 1px solid #add;"></td> </tr> </table>

See the full list of supported data sources.


🛠️ Getting Started

Addax can be quickly installed and used via Docker, installation scripts, or compiled from source.

1. Use docker image

Pull the prebuilt Docker image and run a test job:

docker pull quay.io/wgzhao/addax:latest
docker run -ti --rm --name addax \
  quay.io/wgzhao/addax:latest \
  /opt/addax/bin/addax.sh /opt/addax/job/job.json

2. Use installation script

Install Addax with a single command:

/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/wgzhao/Addax/master/install.sh)"

Installation paths: /usr/local (macOS), /opt/addax/ (Linux).

3. Compile and Package from Source

  • Java Compiler: JDK 17

For developers aiming to create custom-builds, compile and package Addax locally:

git clone https://github.com/wgzhao/addax.git addax
cd addax
export MAVEN_OPTS="-DskipTests -Dmaven.javadoc.skip=true -Dmaven.source.skip=true -Dgpg.skip=true"
mvn clean package
mvn package -Pdistribution

The compiled binary will be in target/addax-<version>.

4. Run Your First Task

Load sample job configuration and test the setup:

bin/addax.sh job/job.json

Explore more example jobs


📖 Runtime Requirements

  • Java Runtime: JDK 17
  • Python Version: Python 2.7+ / 3.7+ (Windows only)

🔗 Related Projects

  • addax-admin - A web-based management tool for administering Addax data collection tasks
  • addax-docs - Comprehensive documentation for Addax, including user guides and API references

🧩 Developing Addax

For AI assistants: project-specific knowledge and conventions are documented in SKILL.md. Please read it before working on this repo.


Code Style Guidelines

Follow general Java conventions and patterns:

  1. Use IntelliJ IDE with Airlift's Code Style
  2. Categorize exceptions clearly with AddaxException (e.g., AddaxException(REQUIRE_VALUE, "missing required parameter")).
  3. Use the Java 8 Stream API cautiously (avoid in performance-sensitive areas).
  4. Avoid ternary operators for non-trivial expressions.
  5. Include proper Apache License headers in every file.

Refer to our Programming Guidelines for commit message formats.


🗓️ Versioning Scheme

This project adheres to the Semantic Versioning (SemVer) standard with the format x.y.z. The meanings of each segment are as follows:

  • z(Patch Version):

    • Bug fixes and performance improvements that do not affect compatibility with existing features.
    • Example: 1.2.3 → 1.2.4
  • y(Minor Version):

    • Introducing new features or module adjustments that could break backward compatibility.
    • Example: 1.2.3 → 1.3.0
  • x(Major Version):

    • Significant changes or new features that are often incompatible with previous versions.
    • Example: 1.3.0 → 2.0.0

🌟 Star History

Star History

<a href="https://www.star-history.com/#wgzhao/Addax&Date"> <picture> <source media="(prefers-color-scheme: dark)" srcset="https://api.star-history.com/svg?repos=wgzhao/Addax&type=Date&theme=dark" /> <source media="(prefers-color-scheme: light)" srcset="https://api.star-history.com/svg?repos=wgzhao/Addax&type=Date" /> <img alt="Star History Chart" src="https://api.star-history.com/svg?repos=wgzhao/Addax&type=Date" /> </picture> </a>

⚖️ License

This software is free to use under the Apache License 2.0.


💌 Special Thanks

Special thanks to JetBrains for providing open-source support to this project.

View on GitHub
GitHub Stars1.4k
CategoryData
Updated6h ago
Forks331

Languages

Java

Security Score

100/100

Audited on Apr 2, 2026

No findings