System Settings
TapData Enterprise can be deployed in your local data center, making it suitable for scenarios with strict requirements on data sensitivity or network isolation. It can serve to build real-time data warehouses, enable real-time data exchange, data migration, and more.The system settings feature is mainly used to configure some parameters of the system, such as logging, SMTP, API distribution, and more.
Accessing System Settingsβ
In the upper-right corner of the page, click on the icon, and then click on System Settings.
Log Settingsβ
Log Level: In the log settings, you can set the log level. Available log levels include: error/warn/info/debug/trace. When you select a level, only logs of that level and higher will be printed in the logs.
Log Filtering Interval (seconds): Set the time interval during which the same log will only appear once (effective after 1 minute).
Log Output Frequency (lines/second): Set the average number of events allowed per second in the log settings.
SMTP Settingsβ
Configure SMTP service settings, including:
- SMTP Service Account: Set the SMTP account.
- SMTP Service Password: Set the password for the SMTP account.
- Encryption Method: Choose the encryption method, supporting SSL and TLS.
- SMTP Service Host: Set the host address of the SMTP service.
- SMTP Service Port: Set the port number of the SMTP service.
- Email Sending Address: Set the email address from which emails will be sent.
- Email Receiving Addresses: Enter the email addresses where alert notifications will be sent, separated by commas (,).
- Email Subject Prefix (Optional): You can set a prefix for the email subject to help you quickly identify the source of the emails.
- SMTP Proxy Service Host (Optional): If the email requires access through a proxy, enter the hostname or IP address of the proxy server.
- SMTP Proxy Service Port (Optional): If the email requires access through a proxy, enter the proxy service port.
After configuring the settings, you can view the email templates. You can test the configuration by conducting a connection test.
After a successful connection test, click the Save button to save the SMTP settings.
API Distribution Settingsβ
Configure API distribution policies, including:
- The Number of Rows returned by the Default Query: Set the default number of rows returned by API queries.
- Maximum Number of Rows Returned by the Query: Set the maximum number of rows returned by API queries.
- Enable API Statistics: Set whether to enable API statistics.
- Maximum Number of API Request Cache: Set the maximum number of cached API requests.
- API Request Report Frequency (seconds): Set the frequency of API request reporting.
Connection Settingsβ
Configure some settings related to connection management, including:
- MongoDB Load Model Sampling Records (rows): Set the number of sampling records when loading MongoDB models.
- Data Source Schema Update Time: Set the specific time for automatic data source schema updates.
- Data Source Schema Update Interval (days): Set the update period for data source schemas in days.
- Allow the Creation of Duplicate Data Sources: Set whether to allow the creation of duplicate data sources.
Operation Display Settingsβ
Operation display settings include:
- O&M Operation Control URL
- Flow Engine Version
- TapData Agent Version
Global System Settingsβ
Global system settings support the following options:
- Maximum CPU Usage (range 0.1 to 1)
- Maximum Heap Memory Usage (range 0.1 to 1)
- License Expiration Reminder
Disaster Drill Settingsβ
Disaster drill settings mainly include:
- Allow Disaster Recovery Exercises
- Mongod Path
- SSH Username
- SSH Port
Background Analysis Settingsβ
Background analysis settings mainly set the interval for data quality analysis. You can adjust these settings according to your needs.
System Resource Monitoring Settingsβ
System resource monitoring settings mainly set the data collection frequency for system resource monitoring. You can adjust these settings according to your needs.
Process Settingsβ
Process settings are primarily used to set the expiration time for process heartbeats.
- Process Heartbeat Period Time (seconds)
Task Settingsβ
Task settings are mainly used to configure some parameters during task runtime. Supported settings include:
- Incremental Lag Decision Time (seconds): Sets the time threshold for determining if a task is lagging.
- Whether to Add the Creation Time to Target Data Set: true or false
- Cache a copy of the current overall data and merge it into the target data set
- Cache a copy of the overall data before modification and merge it into the target data set
- Whether to transfer task logs to the cloud
- Interval time for switching to batch insert mode in incremental mode (unit: second)
- Sampling rate
- Task load threshold (percentage)
- Task load statistics time (minute)
- Illegal characters replaced with
- Synchronization task heartbeat timeout (milliseconds)
- Incremental synchronization task sharing mode
- Incremental tasks are forced to use shared mode
- Automatically save incremental events
- Incremental event save time (days)
- Retry Interval (Second)
- Maximum Retry Time(Minute)