Backup Tool

1. Overview

The IoTDB Full Backup Tool is designed to create a full backup of a single IoTDB node’s data via hard links to a specified local directory. The backup can then be directly started and joined to the original cluster. The tool offers two modes: Quick Mirror Mode and Manual Backup Path Mode.

Notes:

• Stop the IoTDB service before starting the backup.
• The script runs in the background by default, and logs are saved to log files during execution.
• IoTDB version requirement: Must be v1.3.2 or higher.

2. Backup Modes

2.1 Mode 1: Quick Mirror Mode

Usage

1. backup.sh/backup.bat -quick -node xxx
2. # Optional values for xxx are shown in the following examples

4. backup.sh/backup.bat -quick -node
5. # Back up all nodes to the default path

7. backup.sh/backup.bat -quick -node all
8. # Back up all nodes to the default path

10. backup.sh/backup.bat -quick -node confignode
11. # Back up only the ConfigNode to the default path

13. backup.sh/backup.bat -quick -node datanode
14. # Back up only the DataNode to the default path

Parameter Descriptions

Process Details:

1. Check if the _backup folder already exists in the current IoTDB directory or paths specified in the configuration file. If it exists, the tool exits with the error: The backup folder already exists.

When the backup folder already exists, you can try the following solutions:

• Delete the existing _backup folder and retry the backup.
• Modify the backup path to avoid conflicts.

1. Create hard links from the original dn_data_dirs paths to the corresponding _backup paths.
2. Example: If dn_data_dirs=/data/iotdb/data/datanode/data, the backup data will be stored in /data/iotdb/data/datanode/data_backup.
3. Copy other files from the IoTDB directory (e.g., /data/iotdb) to the _backup path (e.g., /data/iotdb_backup).

2.2 Mode 2: Manual Backup Path Mode

Usage

1. backup.sh -node xxx -targetdir xxx -targetdatadir xxx -targetwaldir xxx

Parameter Descriptions

Process Details:

1. The -targetdir parameter is mandatory. If missing, the tool exits with the error: -targetdir cannot be empty. The backup folder must be specified.

2. Validate consistency between configuration paths (dn_data_dirs, dn_wal_dirs) and parameters (-targetdatadir, -targetwaldir):

3. If -targetdatadir or -targetwaldir is a single path, it is considered consistent.

4. If the number of source paths (from configuration) does not match the target paths, the tool exits with the error: -targetdatadir parameter exception: the number of original paths does not match the specified paths.

5. Check if -targetdatadir paths are on the same disk as the original paths:

6. Same disk: Attempt to create hard links. If hard links fail, copy files instead.

7. Different disk: Copy files directly.

8. Path Matching Rules

9. Many-to-One: Multiple source paths can be backed up to a single target path.

10. One-to-One: A single source path can be backed up to a single target path.
11. Many-to-Many: Multiple source paths can be backed up to multiple target paths, but the pattern must match.

Examples

Path Matching Rules Summary

• Paths separated by ; only:
• -targetdatadir can be a single path (no ; or ,).
• -targetdatadir can also use ; to split paths, but the count must match the source paths.
• Paths separated by , only:
• -targetdatadir can be a single path (no ; or ,).
• -targetdatadir can also use , to split paths, but the count must match the source paths.
• Paths with both ; and ,:
• -targetdatadir can be a single path (no ; or ,).
• Split paths first by ;, then by ,. The number of paths at each level must match.

Note: The dn_wal_dirs parameter (for WAL paths) follows the same rules as dn_data_dirs.