Skip to main content

Oracle to Tablestore Real-Time Sync

Applicable EditionsTapData CloudTapData Cloud offers you cloud services that are suitable for scenarios requiring rapid deployment and low initial investment, helping you focus more on business development rather than infrastructure management. Free trial with TapData Cloud.TapData EnterpriseTapData Enterprise can be deployed in your local data center, making it suitable for scenarios with strict requirements on data sensitivity or network isolation. It can serve to build real-time data warehouses, enable real-time data exchange, data migration, and more.TapData CommunityTapData Community is an open-source data integration platform that provides basic data synchronization and transformation capabilities. This helps you quickly explore and implement data integration projects. As your project or business grows, you can seamlessly upgrade to TapData Cloud or TapData Enterprise to access more advanced features and service support.

Alibaba Cloud Tablestore is a serverless table storage service designed for handling large volumes of structured data. It also provides a comprehensive solution for IoT scenarios, offering optimized data storage capabilities. TapData enables real-time synchronization of Oracle data to Tablestore, providing seamless data flow and facilitating easy adaptation to data architecture changes and big data analysis scenarios.

Prerequisites

Before you create a replication task, make sure you have configured the relevant data source:

  1. Configure Oracle Connection
  2. Configure Tablestore Connection

Also note the reference data type support.

Configure Task

  1. Log in to TapData Platform.

  2. Based on the product type, select the operation entry:

    • TapData Cloud: In the left navigation panel, click Data Replications.
    • TapData Enterprise: In the left navigation panel, choose Data Pipelines > Replications.
  3. On the right side of the page, click Create to configure the task.

  4. Drag and drop the Oracle and Tablestore data sources from the left side of the page onto the right canvas. Once they are placed, you can connect them by drawing a line or arrow between the two data sources.

  5. Click on the Oracle data source, choose the desired table in the right panel, and then click on the Tablestore data source to view the synchronized data structure.

    Task Configuration

    tip

    Since the number of columns in a single table in Tablestore cannot exceed 32, if the number of columns in the Oracle tables to be synchronized exceeds 32, you can address this limitation by adding a Field Edit node between the Oracle and Tablestore data sources. This node allows you to handle the situation and selectively exclude business-independent columns from the synchronization process. For more information, see Processing Node.

  6. After confirming the configuration is correct, click Start.

    After the operation is completed, you can observe the performance of the task on the current page, such as RPS (Records Per Second), delay, task time statistics, etc.

    View Task Run Details

Task Management

On the Task List page, you can also start, stop, monitor, edit, copy, reset, and delete tasks.

For more information, See Management Tasks.