TiBigData

License

---

Misc BigData components for TiDB, Presto, Flink and MapReduce connectors for example.

License

TiBigData project is under the Apache 2.0 license. See the LICENSE file for details.

Code style

TiBigData use Google Code Style.

Format the code with the following command:

mvn com.coveo:fmt-maven-plugin:format

Getting Started

Compiling TiBigData requires git and downloading source code directly is not supported.

Flink-TiDB-Connector(Batch)

Flink-TiDB-Connector(Unified Batch & Streaming)

PrestoSQL-TiDB-Connector

Trino-TiDB-Connector

PrestoDB-TiDB-Connector

MapReduce-TiDB-Connector

Hive-TiDB-Storage-Handler

Run Tests

Use the following command to run the integration test.

export TIDB_HOST="127.0.0.1"
export TIDB_PORT="4000"
export TIDB_USER="root"
export TIDB_PASSWORD=""
mvn clean test-compile failsafe:integration-test -am -pl ${MODULE_NAME}

Use the following command to run the unit test.

mvn clean test -am -pl ${MODULE_NAME}

Write integration test

First, make sure the module add dependency:

 <dependency>
      <groupId>io.tidb</groupId>
      <artifactId>bigdata-test</artifactId>
      <version>${project.version}</version>
      <scope>test</scope>
</dependency>

Second, use JUnit Category to clarify integration-test:

import io.tidb.bigdata.test.IntegrationTest;

@Category(IntegrationTest.class)
public class ConnectorsPluginTest {
}

Community

Lark / Feishu Group:

<img src="docs/assets/lark_group.png" width="300">

Supported by

YourKit

YourKit supports open source projects with innovative and intelligent tools for monitoring and profiling Java and .NET applications. YourKit is the creator of <a href="https://www.yourkit.com/java/profiler/">YourKit Java Profiler</a>, <a href="https://www.yourkit.com/.net/profiler/">YourKit .NET Profiler</a>, and <a href="https://www.yourkit.com/youmonitor/">YourKit YouMonitor</a>.

IntelliJ IDEA

<img src="https://resources.jetbrains.com/storage/products/company/brand/logos/IntelliJ_IDEA_icon.png" width="50">

IntelliJ IDEA is a Java integrated development environment (IDE) for developing computer software.
It is developed by JetBrains (formerly known as IntelliJ), and is available as an Apache 2 Licensed community edition,
and in a proprietary commercial edition. Both can be used for commercial development.