Supported Data Sources
Tapdata Cloud supports rich data sources as follows:
tip
If you need to synchronize DDL operations, you need to enable DDL collection and DDL apply. For more information, see Handle DDL Changes During Data Sync.
GA Data Sources
Type | As a source | As a target | Versions | |||
---|---|---|---|---|---|---|
Full data synchronization | Incremental data synchronization | DDL event collection | Data write | DDL event apply | ||
ClickHouse | ➖ | ➖ | ➖ | ✅ | ✅ | 21.x |
Kafka | ✅ | ✅ | ✅ | ✅ | ✅ | 2.3.x, 0.x, 1.x |
MongoDB | ✅ | ✅ | ➖ | ✅ | ➖ | 3.2, 3.4, 3.6, 4.0+ |
MySQL | ✅ | ✅ | ✅ | ✅ | ✅ | 5.0, 5.1, 5.5, 5.6, 5.7, 8.x |
Oracle | ✅ | ✅ | ✅ | ✅ | ✅ | 9i, 10g, 11g, 12c, 19c |
PostgreSQL | ✅ | ✅ | ➖ | ✅ | ✅ | 9.4+ |
SQL Server | ✅ | ✅ | ✅ | ✅ | ✅ | 2005, 2008, 2012, 2014, 2016, 2017 |
Beta Data Sources
tip
The beta version of the data sources is in public preview and has passed the basic test cases and integration test cases, but has not yet passed the Tapdata certification test process. If you have any questions during use, pleasecontact us.
- Common Databases
- File and SaaS
Type | As a source | As a target | Versions | |||
---|---|---|---|---|---|---|
Full data synchronization | Incremental data synchronization | DDL event collection | Data write | DDL event apply | ||
BigQuery | ➖ | ➖ | ➖ | ✅ | ➖ | N/A |
Custom Connection | ✅ | ✅ | ➖ | ✅ | ➖ | N/A |
Dameng | ✅ | ✅ | ✅ | ✅ | ✅ | 7.x, 8.x |
Databend | ➖ | ➖ | ➖ | ✅ | ➖ | 0.9 and above |
IBM Db2 | ✅ | ✅ | ✅ | ✅ | ✅ | 9.7 LUW |
Doris | ➖ | ➖ | ➖ | ✅ | ➖ | 0.15.0 |
DummyDB | ✅ | ✅ | ➖ | ✅ | ➖ | - |
KingBaseES-R6 | ✅ | ✅ | ➖ | ✅ | ✅ | V8R6 |
MariaDB | ✅ | ✅ | ✅ | ✅ | ✅ | 10.x |
Redis | ➖ | ➖ | ➖ | ✅ | ➖ | 2.8 ~ 6.0 |
SelectDB | ➖ | ➖ | ➖ | ✅ | ➖ | MySQL 5.7/8.0 |
TDengine | ✅ | ✅ | ➖ | ✅ | ✅ | 3.x |
TiDB | ✅ | ✅ | ➖ | ✅ | ✅ | 5.x |
Type | As a source | As a target | Versions | |||
---|---|---|---|---|---|---|
Full data synchronization | Incremental data synchronization | DDL event collection | Data write | DDL event apply | ||
Coding | ✅ | ✅ | ➖ | ➖ | ➖ | N/A |
CSV | ✅ | ✅ | ➖ | ➖ | ➖ | N/A, file locations supported include local, FTP, SFTP, SMB, S3FS, OSS. |
Microsoft Excel | ✅ | ✅ | ➖ | ➖ | ➖ | XLS/XLSX Format, file locations supported include local, FTP, SFTP, SMB, S3FS, OSS. |
Lark-IM | ➖ | ➖ | ➖ | ✅ | ➖ | N/A |
LarkTask | ➖ | ➖ | ➖ | ✅ | ➖ | N/A |
Zoho-CRM | ✅ | ➖ | ➖ | ➖ | ➖ | N/A |
Alpha Data Sources
tip
The Alpha version of the data sources is in public preview and has passed the basic test cases, but has not yet passed the integration test cases and the Tapdata certification test process. If you have any questions during use, please contact us.
- Common Databases
- Cloud Databases
- Message Queue
- File and SaaS
Type | As a source | As a target | Versions | |||
---|---|---|---|---|---|---|
Full data synchronization | Incremental data synchronization | DDL event collection | Data write | DDL event apply | ||
ElasticSearch | ➖ | ➖ | ➖ | ✅ | ➖ | 5.x, 6.x, 7.x |
Gbase 8a | ➖ | ➖ | ➖ | ✅ | ➖ | 8x |
Gbase 8s | ➖ | ➖ | ➖ | ✅ | ➖ | 8x |
Hive 1 | ➖ | ➖ | ➖ | ✅ | ➖ | 3.1.2+ |
KingBaseES-R3 | ✅ | ➖ | ➖ | ✅ | ✅ | V8R3 |
OceanBase (MySQL mode) | ➖ | ➖ | ➖ | ✅ | ➖ | 3.x |
OpenGauss | ✅ | ➖ | ➖ | ✅ | ✅ | 3.0.0 and above |
MySQL PXC | ✅ | ✅ | ➖ | ✅ | ➖ | 5.0, 5.1, 5.5, 5.6, 5.7, 8.x |
QuickAPI | ✅ | ➖ | ➖ | ➖ | ➖ | N/A |
Type | As a source | As a target | Versions | |||
---|---|---|---|---|---|---|
Full data synchronization | Incremental data synchronization | DDL event collection | Data write | DDL event apply | ||
AWS RDS MySQL | ✅ | ✅ | ➖ | ✅ | ➖ | 5.0, 5.1, 5.5, 5.6, 5.7, 8.x |
Aliyun Tablestore | ➖ | ➖ | ➖ | ✅ | ➖ | 5.13.9 |
Aliyun AnalyticDB MySQL | ✅ | ✅ | ➖ | ➖ | ➖ | 5.0, 5.1, 5.5, 5.6, 5.7, 8.x |
Aliyun AnalyticDB PostgreSQL | ✅ | ✅ | ➖ | ✅ | ➖ | 9.4, 9.5, 9.6, 10.x, 11.x, 12 |
Aliyun RDS MySQL | ✅ | ✅ | ➖ | ✅ | ➖ | 5.0, 5.1, 5.5, 5.6, 5.7, 8.x |
Aliyun RDS MariaDB | ✅ | ✅ | ➖ | ✅ | ➖ | 10.3 |
Aliyun RDS MongoDB | ✅ | ✅ | ➖ | ✅ | ➖ | MongoDB 3.2, 3.4, 3.6, 4.0, 4.2 |
Aliyun RDS PostgreSQL | ✅ | ✅ | ➖ | ✅ | ➖ | 9.4, 9.5, 9.6, 10.x, 11.x, 12 |
Aliyun RDS SQL Server | ✅ | ✅ | ➖ | ✅ | ➖ | 2008 R2, 2012, 2014, 2016, 2017, 2019 |
PolarDB MySQL | ✅ | ✅ | ➖ | ✅ | ➖ | 5.6, 5.7, 8.0 |
PolarDB PostgreSQL | ✅ | ✅ | ➖ | ✅ | ➖ | 11 |
TencentDB MariaDB | ✅ | ✅ | ➖ | ✅ | ➖ | MariaDB 10.1.9, Percona 5.7.17, MySQL 8.0.18 |
TencentDB MongoDB | ✅ | ✅ | ➖ | ✅ | ➖ | MongoDB 3.2, 3.4, 3.6, 4.0, 4.2 |
TencentDB MySQL | ✅ | ✅ | ➖ | ✅ | ➖ | 5.5, 5.6, 5.7, 8.x |
TencentDB PostgreSQL | ✅ | ✅ | ➖ | ✅ | ➖ | 9.4, 9.5, 9.6, 10.x, 11.x, 12 |
TencentDB SQL Server | ✅ | ✅ | ➖ | ✅ | ➖ | 2008 R2, 2012, 2016, 2017, 2019 |
Type | As a source | As a target | Versions | |||
---|---|---|---|---|---|---|
Full data synchronization | Incremental data synchronization | DDL event collection | Data write | DDL event apply | ||
ActiveMQ | ✅ | ✅ | ➖ | ✅ | ➖ | 5.14.x |
RabbitMQ | ✅ | ✅ | ➖ | ✅ | ➖ | 3.8.x |
RocketMQ | ✅ | ✅ | ➖ | ✅ | ➖ | 4.9.x |
Type | As a source | As a target | Versions | |||
---|---|---|---|---|---|---|
Full data synchronization | Incremental data synchronization | DDL event collection | Data write | DDL event apply | ||
JSON | ✅ | ✅ | ➖ | ➖ | ➖ | N/A, file locations supported include local, FTP, SFTP, SMB, S3FS, OSS. |
Vika | ➖ | ➖ | ➖ | ✅ | ➖ | V1 |
XML | ✅ | ✅ | ➖ | ➖ | ➖ | N/A, file locations supported include local, FTP, SFTP, SMB, S3FS, OSS. |