Skip to main content

Deploy and Manage Agent

This article lists common problems encountered by Tapdata Agent in deployment and operation.

Deploy Agent​

What is the role of the agent?​

The Tapdata Agent plays a crucial role in data synchronization, handling data heterogeneity, and supporting data transformation scenarios. It is responsible for extracting data from the source system, performing necessary processing, and transmitting it to the target system. The Tapdata Agent is centrally managed by Tapdata Cloud. The workflow for data synchronization typically follows these steps:

Agent Architecture

tip

Tapdata Agent obtains data from the source, processes and transforms it, then sends it to its target. The data is not uploaded or stored in Tapdata Cloud.

Where is the Agent deployed?​

The Tapdata Agent should be installed in the local network where the database is located since data flow is usually time-sensitive.

See Deploying Tapdata Agent for more information.

How many agents need to be deployed?​

The installation of at least one Tapdata Agent is necessary to initiate and carry out the synchronization process. However, the exact number of agents required can vary based on specific business needs and requirements.

Can multiple agents be deployed?​

Yes, you can deploy multiple agents.

tip

A task will only run on one agent, and when there are many tasks, multiple agents can be deployed to improve the workload.

In the event of an exception occurring with an Agent, how can I replace or change the Agent associated with a task?​

To change the Agent for a task when an exception occurs, you can edit the task and manually assign a working Agent. Additionally, you can troubleshoot the abnormal Agent to address the issue.

Specify Agent

How should the Tapdata Agent be deployed when Oracle is in RAC mode with two nodes?​

When Oracle is in RAC mode with two nodes, the Tapdata Agent can be deployed on a separate device as long as it can establish a connection to the SCAN/VIP of the RAC environment. It is not necessary for the Agent to be deployed on the same device with Oracle.

What should I do if the test fails after installing Docker on Windows (64-bit)?​

The best way to deploy Agent is directly through Docker.

How do I get the tokens needed for deployment again?​

1 token is only used to deploy 1 agent, if you want to deploy multiple agents, please go to Tapdata Cloud to create an agent.

How can the deployment status of the Tapdata Agent be detected?​

To detect the deployment status of the Tapdata Agent, follow the provided instructions to complete the deployment process. Once the deployment is finished, the Agent state will automatically change to running. If more than 5 minutes have passed and the state has not changed to normal, it may indicate a deployment failure. In such cases, it is recommended to contact technical support for assistance. Providing logs will aid in identifying and resolving the problem effectively.

Manage Agent​

Agent startup error: "start timout"?​

If you encounter the failure of starting the Agent, you can check the log file logs/tapdata-agent.log in the installation directory to determine whether it is a network problem, you can also contact us for technical support.

Enter the token and report an error: "java.lang.IllegalStateException: Cannot load configuration class: io.tapdata.Application"?​

The package is incomplete. Please replace it with a new version.

How do I check the status of my Agent?​

  • View by command: Log in to the device where the Agent is deployed and enter the Agent installation directory, execute the ./tapdata status command, as shown in the following example, the Agent is normally running.

    Command to check the status of the Agent

  • View through the interface: Log in to the Tapdata Cloud, click Agent in the left navigation bar to view the status of all agents, and click Agent name to get the directory, logs, and other information of the Agent.

    Check the status of the Agent

Agent unexpectedly stopped, how to start the agent?​

Log in to the device where the Agent is deployed and enter the Agent installation directory, execute the ./tapdata start command, if you cannot start, you can contact us for technical support, and provide logs to assist in locating the problem.

The Agent is running normally, but appears to be offline in Tapdata Cloud?​

The Agent reports the heartbeat to the Tapdata Cloud every minute, and if the Tapdata Cloud does not receive the heartbeat information for five consecutive minutes, the Agent is displayed offline, usually due to network fluctuations.

The Agent offline does not affect the normal operation of the running task, but the newly created task is affected.

What is the process for uninstalling and reinstalling the Tapdata Agent?​

Select the following methods to uninstall the Reinstall Agent according to your platform:

  • Docker: Delete the container directly, and then rerun the command to start the container to complete the installation.
  • Linux/Windows:
    • Fresh Install
      1. Execute the command stop service: ./tapdata stop -f.
      2. Delete the installation directory.
      3. Create an Agent on Tapdata Cloud and follow the prompts to complete the deployment.
    • Retain Configuration Reinstall
      1. Save the configuration file application.yml in the Agent installation directory.
      2. Execute the command stop service: ./tapdata stop -f.
      3. Delete the installation directory.
      4. Create a new installation directory and copy application.yml to it.
      5. Download the tapdata agent.
      6. Execute ./tapdata start backend

Agent runtime error: "OutOfMemoryError"​

It is necessary to confirm that the Agent device has sufficient available memory. The solution is as follows:

  • Out of memory: Replace the device where the Agent is deployed, or try reducing the value of Batch read number for tasks in the Tapdata Cloud.

  • Memory is plentiful

    1. In the Agent installation directory, locate and modify the application.yml file

    2. Adjust the memory size according to the available memory. For example, add the following configuration in the file: tapdataJavaOpts: "-Xms4G -Xmx8G", that is, the initial memory is 4GB, and the maximum memory is 8GB.

      tapdata:
          conf:
              tapdataPort: '3030'
              backendUrl: 'https://cloud.tapdata.io/api/'
              apiServerPort: ""
              tapdataJavaOpts: "-Xms4G -Xmx8G"
              reportInterval: 20000
              uuid: a5f266a1-a495-412f-a433-29d345713c176
          cloud:
              accessCode: ""
              baseURLs: 'https://cloud.tapdata.io/api/'
              username: null
              token:
      spring:
          data:
              mongodb:
                  username: ""
                  password: ""
                  mongoConnectionString: ""
                  uri: ""
                  ssl: ""
                  sslCA: ""
                  sslCertKey: ""
                  sslPEMKeyFilePassword: ""
                  authenticationDatabase: ""

  1. After saving, execute the following command to restart the agent.

    # Stop Agent
    ./tapdata stop -f
    # Start Agent
    ./tapdata start