Data Transformation

To configure data transformation tasks with advanced data processing requirements such as table merging, data splitting, field adding/deleting, and data sharing without impacting the user's business, you can add processing nodes. This enables data processing, disaster recovery, and analysis scenarios.

📄️ Create a Data Transformation Task

In Tapdata Cloud, data transformation tasks provide the capability to incorporate processing nodes between source and target data nodes. These processing nodes serve as valuable tools for efficiently carrying out data processing tasks, such as merging multiple tables, splitting data, and adding or removing fields.

📄️ Builde Real-Time Materialized Views (Beta)

Materialized views are specialized database object that cache the results of intricate queries, thereby accelerating data retrieval. With Tapdata Cloud, you can craft real-time materialized views across diverse data sources. This not only ensures accuracy and immediacy of data but also streamlines data management and application development.

📄️ Manage Data Transformation Task

After the replication task is created, you can monitor and manage the task in the task list.

📄️ Add Processing Node

Tapdata Cloud supports the addition of processing nodes to data replication or pipeline tasks, providing the flexibility to incorporate data filtering, field adjustments, and other processing operations as needed. This allows users to customize and enhance their data replication workflows based on specific requirements.

📄️ Monitor Data Transformation Task

Once the data transformation task is started, the page will automatically redirect to the task monitoring page. From there, you can monitor the task's operation details, such as the status of the Agent, data synchronization progress, task progress, alarm settings, and other relevant information.