Architecture and Workflow

TapData Cloud offers you cloud services that are suitable for scenarios requiring rapid deployment and low initial investment, helping you focus more on business development rather than infrastructure management. Free trial with TapData Cloud.TapData Enterprise can be deployed in your local data center, making it suitable for scenarios with strict requirements on data sensitivity or network isolation. It can serve to build real-time data warehouses, enable real-time data exchange, data migration, and more.TapData Community is an open-source data integration platform that provides basic data synchronization and transformation capabilities. This helps you quickly explore and implement data integration projects. As your project or business grows, you can seamlessly upgrade to TapData Cloud or TapData Enterprise to access more advanced features and service support.

As a new-generation real-time data service platform, TapData enables enterprises to easily break the limitations of data silos. It provides real-time, accurate data for analytical and transactional business workloads through real-time data collection technology, flexible data processing methods, comprehensive data governance capabilities, and convenient data publishing methods, supporting businesses in achieving more agile innovation.

TapData Cloud Architecture

TapData Cloud components include TapData Cloud Manager and TapData Agent:

• TapData Cloud Manager (TCM): Responsible for installing and configuring agents, as well as designing data tasks and monitoring the status of tasks.
• TapData Agent: Obtain task information from the TapData Cloud Manager (TCM), processing and converting the data to be sent to the target, and reporting the task status back to the TCM during the execution of the task.

TapData employs a range of cyber-security measures to ensure the protection and security of user data and information.

• One-way Connection: The TapData Agent instance does not actively expose network information, and only connects to the TCM management service to obtain task information and report status information.
• HTTPS Protocol: TapData Agent instances establish communication with TCM using the HTTPS protocol, ensuring protection against information theft and tampering.
• Trusted Environment: In self-built mode, all data is transmitted exclusively within the user's server and networking environment, ensuring that there is no risk of data leakage.

TapData Enterprise Architecture

TapData Enterprise is structured into four layers, from left to right:

• Data Collection Layer: Based on log parsing capabilities and through established plugin data connectors, it collects changes in data sources in real-time and standardizes them. The standardized data then enters the stream processing framework.
• Stream Data Processing Layer: Through TapData's proprietary solution, data computation, modeling, and transformation are completed within the process, quickly yielding results that move into the storage layer.
• Storage Layer: By the time data is placed into the storage layer, a logical model has already been formed. Users only need to focus on the data required for their business, without concern for the storage location.
• Service Layer: In the service layer, there are two mainstream data service models: Pull and Push. The API supports low-code publishing and can be released according to specific needs. When the required data is already stored in the business system, it can be pushed to users through REVERSE ETL after being organized with governance applied.

tip

If you do not need to deploy TapData locally, you can choose to use TapData Cloud. For more introduction, see Version Comparison.