manticoresoftware / manticoresearch-backup

Repository for Manticore Search backup scripts
GNU General Public License v3.0
3 stars 1 forks source link

Uncomment important env for release #114

Closed donhardman closed 3 months ago

github-actions[bot] commented 3 months ago

clt

👎 CLT tests in tests/ ✅ OK: 1 ❌ Failed: 7 ⏳ Duration: 23s 👉 Check Action Results for commit 6f72e1b Failed tests:

tests/backup-shebang-config-ok.rec ```diff ––– input ––– cp tests/config/manticore.sh /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– searchd ––– output ––– - Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (secondary %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (knn %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) + Manticore 6.2.13 27789eb1c@24052205 dev (columnar 2.2.5 b41a4fc@24051705) (secondary 2.2.5 b41a4fc@24051705) (knn 2.2.5 b41a4fc@24051705) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on all interfaces for mysql, port=9306 listening on UNIX socket /var/run/mysqld/mysqld.sock listening on %{IPADDR}:9312 for sphinx and http(s) listening on all interfaces for sphinx and http(s), port=9308 ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– ––– input ––– ls -lt /tmp/backup-* ––– output ––– ls: cannot access '/tmp/backup-*': No such file or directory ––– input ––– manticore-backup --backup-dir=/tmp ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... %{DATETIME} [Info] Backing up config files... %{DATETIME} [Info] config files - OK %{DATETIME} [Info] Backing up global state files... %{DATETIME} [Info] global state files – OK %{DATETIME} [Info] Backing up tables... %{DATETIME} [Info] distributed_index (distributed)... %{DATETIME} [Info] SKIP %{DATETIME} [Info] rt_with_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] test (rt) [%{NUMBER}B]... %{DATETIME} [Info] OK %{DATETIME} [Info] Running sync %{DATETIME} [Info] OK %{DATETIME} [Info] You can find backup here: /tmp/backup-%{NUMBER} %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s %{DATETIME} [Info] Done %{DATETIME} [Info] Unfreezing all tables... %{DATETIME} [Info] distributed_index... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_with_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] test... %{DATETIME} [Info] OK ––– input ––– ls -lh /tmp/backup-* ––– output ––– total 16K %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# config %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# data %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# state %{FILEPERMS} %{NUMBER} root root %{NUMBER} #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# versions.json ```
tests/backup-restore-ok.rec ```diff ––– input ––– cp ./tests/config/manticore.conf /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– searchd ––– output ––– - Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (secondary %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (knn %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) + Manticore 6.2.13 27789eb1c@24052205 dev (columnar 2.2.5 b41a4fc@24051705) (secondary 2.2.5 b41a4fc@24051705) (knn 2.2.5 b41a4fc@24051705) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– +---------------------+-------------+ | Index | Type | +---------------------+-------------+ | distributed_index | distributed | | rt_with_columnar | rt | | rt_without_columnar | rt | | test | rt | +---------------------+-------------+ ––– input ––– manticore-backup --backup-dir=/tmp ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... %{DATETIME} [Info] Backing up config files... %{DATETIME} [Info] config files - OK %{DATETIME} [Info] Backing up global state files... %{DATETIME} [Info] global state files – OK %{DATETIME} [Info] Backing up tables... %{DATETIME} [Info] distributed_index (distributed)... %{DATETIME} [Info] SKIP %{DATETIME} [Info] rt_with_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] test (rt) [%{NUMBER}B]... %{DATETIME} [Info] OK %{DATETIME} [Info] Running sync %{DATETIME} [Info] OK %{DATETIME} [Info] You can find backup here: /tmp/backup-%{NUMBER} %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s %{DATETIME} [Info] Done %{DATETIME} [Info] Unfreezing all tables... %{DATETIME} [Info] distributed_index... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_with_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] test... %{DATETIME} [Info] OK ––– input ––– mv /tmp/backup-* /tmp/backup-111 ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp Available backups: 1 backup-111 (?) ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp - %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","secondary":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","knn":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","buddy":"%{SEMVER}"} + 2024-05-22 07:27:55 [Info] Stored versions: {"backup":"1.3.7","manticore":"6.2.13 27789eb1c@24052205 dev","columnar":"2.2.5 b41a4fc@24051705","secondary":"2.2.5 b41a4fc@24051705","knn":"2.2.5 b41a4fc@24051705","buddy":"0.0.0"} - %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","secondary":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","knn":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","buddy":"0.0.0"} + 2024-05-22 07:27:55 [Info] Current versions: {"backup":"1.3.7","manticore":"6.2.13 27789eb1c@24052205 dev","columnar":"2.2.5 b41a4fc@24051705","secondary":"2.2.5 b41a4fc@24051705","knn":"2.2.5 b41a4fc@24051705","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... %{DATETIME} [Error] Cannot initiate the restore process due to searchd daemon is running. ––– input ––– pgrep -f searchd | xargs kill -9 ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp - %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","secondary":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","knn":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","buddy":"%{SEMVER}"} + 2024-05-22 07:27:55 [Info] Stored versions: {"backup":"1.3.7","manticore":"6.2.13 27789eb1c@24052205 dev","columnar":"2.2.5 b41a4fc@24051705","secondary":"2.2.5 b41a4fc@24051705","knn":"2.2.5 b41a4fc@24051705","buddy":"0.0.0"} - %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","secondary":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","knn":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","buddy":"0.0.0"} + 2024-05-22 07:27:55 [Info] Current versions: {"backup":"1.3.7","manticore":"6.2.13 27789eb1c@24052205 dev","columnar":"2.2.5 b41a4fc@24051705","secondary":"2.2.5 b41a4fc@24051705","knn":"2.2.5 b41a4fc@24051705","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... Manticore config endpoint = http://%{IPADDR}:9312 %{DATETIME} [Error] Destination file already exists: /etc/manticoresearch/manticore.conf ––– input ––– rm /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp - %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","secondary":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","knn":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","buddy":"%{SEMVER}"} + 2024-05-22 07:27:55 [Info] Stored versions: {"backup":"1.3.7","manticore":"6.2.13 27789eb1c@24052205 dev","columnar":"2.2.5 b41a4fc@24051705","secondary":"2.2.5 b41a4fc@24051705","knn":"2.2.5 b41a4fc@24051705","buddy":"0.0.0"} - %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","secondary":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","knn":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","buddy":"0.0.0"} + 2024-05-22 07:27:55 [Info] Current versions: {"backup":"1.3.7","manticore":"6.2.13 27789eb1c@24052205 dev","columnar":"2.2.5 b41a4fc@24051705","secondary":"2.2.5 b41a4fc@24051705","knn":"2.2.5 b41a4fc@24051705","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... Manticore config endpoint = http://%{IPADDR}:9312 %{DATETIME} [Error] Destination file already exists: /var/lib/manticore/manticore.json ––– input ––– rm -fr /var/lib/manticore && mkdir -p /var/lib/manticore ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp - %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","secondary":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","knn":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","buddy":"%{SEMVER}"} + 2024-05-22 07:27:55 [Info] Stored versions: {"backup":"1.3.7","manticore":"6.2.13 27789eb1c@24052205 dev","columnar":"2.2.5 b41a4fc@24051705","secondary":"2.2.5 b41a4fc@24051705","knn":"2.2.5 b41a4fc@24051705","buddy":"0.0.0"} - %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","secondary":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","knn":"%{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#","buddy":"0.0.0"} + 2024-05-22 07:27:55 [Info] Current versions: {"backup":"1.3.7","manticore":"6.2.13 27789eb1c@24052205 dev","columnar":"2.2.5 b41a4fc@24051705","secondary":"2.2.5 b41a4fc@24051705","knn":"2.2.5 b41a4fc@24051705","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... Manticore config endpoint = http://%{IPADDR}:9312 %{DATETIME} [Info] Restoring config files... %{DATETIME} [Info] config files - OK %{DATETIME} [Info] Restoring state files... %{DATETIME} [Info] state files - OK %{DATETIME} [Info] Restoring data files... %{DATETIME} [Info] tables' files - OK %{DATETIME} [Info] The backup '/tmp/backup-111' was successfully restored. %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s %{DATETIME} [Info] Done ––– input ––– searchd ––– output ––– - Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (secondary %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (knn %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) + Manticore 6.2.13 27789eb1c@24052205 dev (columnar 2.2.5 b41a4fc@24051705) (secondary 2.2.5 b41a4fc@24051705) (knn 2.2.5 b41a4fc@24051705) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) precaching table 'rt_with_columnar' precaching table 'rt_without_columnar' precaching table 'test' WARNING: table 'distributed_index': ha_strategy defined, but no ha agents in the table precached 3 tables in #!/([0-9]+\.[0-9]+|0)/!# sec ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– +---------------------+-------------+ | Index | Type | +---------------------+-------------+ | distributed_index | distributed | | rt_with_columnar | rt | | rt_without_columnar | rt | | test | rt | +---------------------+-------------+ ```
tests/backup-works-with-max-connections.rec ```diff ––– input ––– cp tests/config/manticore-vip.conf /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– searchd ––– output ––– - Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (secondary %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (knn %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) + Manticore 6.2.13 27789eb1c@24052205 dev (columnar 2.2.5 b41a4fc@24051705) (secondary 2.2.5 b41a4fc@24051705) (knn 2.2.5 b41a4fc@24051705) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9307 for VIP mysql listening on %{IPADDR}:9308 for sphinx and http(s) listening on %{IPADDR}:9313 for VIP sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– ––– input ––– curl localhost:9312/sql?mode=raw -d 'query=debug sleep 10' & ––– output ––– [1] %{NUMBER} ––– input ––– mysql -h0 -P9307 -e 'show tables' ––– output ––– +---------------------+-------------+ | Index | Type | +---------------------+-------------+ | distributed_index | distributed | | rt_with_columnar | rt | | rt_without_columnar | rt | | test | rt | +---------------------+-------------+ ––– input ––– mysql -h0 -P9307 -e 'show create table distributed_index' ––– output ––– +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Table | Create Table | +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | distributed_index | CREATE TABLE distributed_index type='distributed' local='rt_with_columnar' local='rt_without_columnar' agent='127.0.0.1:9312:plain_with_columnar, plain_without_columnar' | +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9307 -e 'show create table rt_with_columnar' ––– output ––– +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Table | Create Table | +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | rt_with_columnar | CREATE TABLE rt_with_columnar ( id bigint, title text, category_id integer, price float, description string attribute engine='columnar', tags multi, attributes json ) | +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9307 -e 'show create table rt_without_columnar' ––– output ––– +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ | Table | Create Table | +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ | rt_without_columnar | CREATE TABLE rt_without_columnar ( id bigint, title text, category_id integer, price float, description string attribute, tags multi, attributes json ) | +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– ls -lt /tmp/backup-* ––– output ––– ls: cannot access '/tmp/backup-*': No such file or directory ––– input ––– manticore-backup --backup-dir=/tmp ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9313 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... %{DATETIME} [Info] Backing up config files... %{DATETIME} [Info] config files - OK %{DATETIME} [Info] Backing up global state files... %{DATETIME} [Info] global state files – OK %{DATETIME} [Info] Backing up tables... %{DATETIME} [Info] distributed_index (distributed)... %{DATETIME} [Info] SKIP %{DATETIME} [Info] rt_with_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] test (rt) [%{NUMBER}B]... %{DATETIME} [Info] OK %{DATETIME} [Info] Running sync %{DATETIME} [Info] OK %{DATETIME} [Info] You can find backup here: /tmp/backup-%{NUMBER} %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s %{DATETIME} [Info] Done ––– input ––– ls -lh /tmp/backup-* ––– output ––– total 16K %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# config %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# data %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# state %{FILEPERMS} %{NUMBER} root root %{NUMBER} #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# versions.json ```
tests/backup-fails.rec ```diff ––– input ––– cp ./tests/config/manticore.conf /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– searchd ––– output ––– - Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (secondary %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (knn %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) + Manticore 6.2.13 27789eb1c@24052205 dev (columnar 2.2.5 b41a4fc@24051705) (secondary 2.2.5 b41a4fc@24051705) (knn 2.2.5 b41a4fc@24051705) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– +---------------------+-------------+ | Index | Type | +---------------------+-------------+ | distributed_index | distributed | | rt_with_columnar | rt | | rt_without_columnar | rt | | test | rt | +---------------------+-------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table distributed_index' ––– output ––– +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Table | Create Table | +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | distributed_index | CREATE TABLE distributed_index type='distributed' local='rt_with_columnar' local='rt_without_columnar' agent='127.0.0.1:9312:plain_with_columnar, plain_without_columnar' | +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table rt_with_columnar' ––– output ––– +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Table | Create Table | +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | rt_with_columnar | CREATE TABLE rt_with_columnar ( id bigint, title text, category_id integer, price float, description string attribute engine='columnar', tags multi, attributes json ) | +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table rt_without_columnar' ––– output ––– +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ | Table | Create Table | +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ | rt_without_columnar | CREATE TABLE rt_without_columnar ( id bigint, title text, category_id integer, price float, description string attribute, tags multi, attributes json ) | +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– ls -lt /tmp/non-exist ––– output ––– ls: cannot access '/tmp/non-exist': No such file or directory ––– input ––– manticore-backup --backup-dir=/tmp/non-exist ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) %{DATETIME} [Error] Failed to find backup dir to store backup: /tmp/non-exist ––– input ––– manticore-backup --backup-dir=/tmp --tables=none ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: none Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... %{DATETIME} [Error] Can't find some of the tables: none ––– input ––– pgrep -f searchd | xargs kill ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 %{DATETIME} [Error] Failed to send query to the Manticore Search daemon. Ensure that it is set up to listen for HTTP or HTTPS connections and has the appropriate certificates in place. Additionally, check the 'max_connections' setting in the configuration file to ensure that it has not been exceeded. ```
tests/backup-all-ok.rec ```diff ––– input ––– cp ./tests/config/manticore.conf /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– searchd ––– output ––– - Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (secondary %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (knn %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) + Manticore 6.2.13 27789eb1c@24052205 dev (columnar 2.2.5 b41a4fc@24051705) (secondary 2.2.5 b41a4fc@24051705) (knn 2.2.5 b41a4fc@24051705) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– +---------------------+-------------+ | Index | Type | +---------------------+-------------+ | distributed_index | distributed | | rt_with_columnar | rt | | rt_without_columnar | rt | | test | rt | +---------------------+-------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table distributed_index' ––– output ––– +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Table | Create Table | +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | distributed_index | CREATE TABLE distributed_index type='distributed' local='rt_with_columnar' local='rt_without_columnar' agent='127.0.0.1:9312:plain_with_columnar, plain_without_columnar' | +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table rt_with_columnar' ––– output ––– +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Table | Create Table | +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | rt_with_columnar | CREATE TABLE rt_with_columnar ( id bigint, title text, category_id integer, price float, description string attribute engine='columnar', tags multi, attributes json ) | +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table rt_without_columnar' ––– output ––– +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ | Table | Create Table | +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ | rt_without_columnar | CREATE TABLE rt_without_columnar ( id bigint, title text, category_id integer, price float, description string attribute, tags multi, attributes json ) | +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– ls -lt /tmp/backup-* ––– output ––– ls: cannot access '/tmp/backup-*': No such file or directory ––– input ––– mysql -h0 -P9306 -e "flush ramchunk test; select * from test.@files;" ––– output ––– +------+---------------------------------------+---------------------------------------+--------+ | id | file | normalized | size | +------+---------------------------------------+---------------------------------------+--------+ | 2 | /var/lib/manticore/test/test.settings | /var/lib/manticore/test/test.settings | %{NUMBER} | | 3 | /var/lib/manticore/test/test.0.sph | /var/lib/manticore/test/test.0.sph | %{NUMBER} | | 4 | /var/lib/manticore/test/test.0.spd | /var/lib/manticore/test/test.0.spd | %{NUMBER} | | 5 | /var/lib/manticore/test/test.0.spp | /var/lib/manticore/test/test.0.spp | %{NUMBER} | | 6 | /var/lib/manticore/test/test.0.spe | /var/lib/manticore/test/test.0.spe | %{NUMBER} | | 7 | /var/lib/manticore/test/test.0.spi | /var/lib/manticore/test/test.0.spi | %{NUMBER} | | 8 | /var/lib/manticore/test/test.0.spm | /var/lib/manticore/test/test.0.spm | %{NUMBER} | | 9 | /var/lib/manticore/test/test.0.sphi | /var/lib/manticore/test/test.0.sphi | %{NUMBER} | | 10 | /var/lib/manticore/test/test.0.spds | /var/lib/manticore/test/test.0.spds | %{NUMBER} | | 11 | /var/lib/manticore/test/test.0.spknn | /var/lib/manticore/test/test.0.spknn | %{NUMBER} | | 12 | /var/lib/manticore/test/test.0.spt | /var/lib/manticore/test/test.0.spt | %{NUMBER} | | 13 | /var/lib/manticore/test/test.0.spidx | /var/lib/manticore/test/test.0.spidx | %{NUMBER} | | 14 | /var/lib/manticore/test/test.0.spa | /var/lib/manticore/test/test.0.spa | %{NUMBER} | | 15 | /var/lib/manticore/test/test.0.spb | /var/lib/manticore/test/test.0.spb | %{NUMBER} | | 1 | /var/lib/manticore/test/test.meta | /var/lib/manticore/test/test.meta | %{NUMBER} | +------+---------------------------------------+---------------------------------------+--------+ ––– input ––– manticore-backup --backup-dir=/tmp ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... %{DATETIME} [Info] Backing up config files... %{DATETIME} [Info] config files - OK %{DATETIME} [Info] Backing up global state files... %{DATETIME} [Info] global state files – OK %{DATETIME} [Info] Backing up tables... %{DATETIME} [Info] distributed_index (distributed)... %{DATETIME} [Info] SKIP %{DATETIME} [Info] rt_with_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] test (rt) [#!/[0-9]{3}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] Running sync %{DATETIME} [Info] OK %{DATETIME} [Info] You can find backup here: /tmp/backup-#!/[0-9]{14}/!# %{DATETIME} [Info] Elapsed time: #!/[0-9]+/!#.#!/[0-9]+/!#s %{DATETIME} [Info] Done %{DATETIME} [Info] Unfreezing all tables... %{DATETIME} [Info] distributed_index... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_with_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] test... %{DATETIME} [Info] OK ––– input ––– ls -lh /tmp/backup-* ––– output ––– total 16K %{FILEPERMS} %{NUMBER} root root 4.0K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# config %{FILEPERMS} %{NUMBER} root root 4.0K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# data %{FILEPERMS} %{NUMBER} root root 4.0K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# state %{FILEPERMS} %{NUMBER} root root %{NUMBER} #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# versions.json ––– input ––– ls -1v /tmp/backup-*/data/test/ ––– output ––– test.meta test.settings test.0.spa test.0.spb test.0.spd test.0.spds test.0.spe test.0.sph test.0.sphi test.0.spi test.0.spidx test.0.spknn test.0.spm test.0.spp test.0.spt ```
tests/backup-conf.rec ```diff ––– input ––– cp /etc/manticoresearch/manticore.conf /tmp/ ––– output ––– ––– input ––– cp ./tests/config/manticore.conf /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– searchd ––– output ––– - Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (secondary %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (knn %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) + Manticore 6.2.13 27789eb1c@24052205 dev (columnar 2.2.5 b41a4fc@24051705) (secondary 2.2.5 b41a4fc@24051705) (knn 2.2.5 b41a4fc@24051705) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– +---------------------+-------------+ | Index | Type | +---------------------+-------------+ | distributed_index | distributed | | rt_with_columnar | rt | | rt_without_columnar | rt | | test | rt | +---------------------+-------------+ ––– input ––– manticore-backup --config=/etc/manticoresearch/manticore.conf --config=/tmp/manticore.conf --backup-dir=/tmp/ ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp/ Manticore config endpoint = http://%{IPADDR}:9312 Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... %{DATETIME} [Info] Backing up config files... %{DATETIME} [Info] config files - OK %{DATETIME} [Info] Backing up global state files... %{DATETIME} [Info] global state files – OK %{DATETIME} [Info] Backing up tables... %{DATETIME} [Info] distributed_index (distributed)... %{DATETIME} [Info] SKIP %{DATETIME} [Info] rt_with_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] test (rt) [%{NUMBER}B]... %{DATETIME} [Info] OK %{DATETIME} [Info] Running sync %{DATETIME} [Info] OK %{DATETIME} [Info] You can find backup here: /tmp/backup-%{NUMBER} %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s %{DATETIME} [Info] Done %{DATETIME} [Info] Unfreezing all tables... %{DATETIME} [Info] distributed_index... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_with_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] test... %{DATETIME} [Info] OK ––– input ––– rm -rf /etc/manticoresearch/manticore.conf /tmp/manticore.conf /var/lib/manticore; mkdir /var/lib/manticore; ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp/ --restore ––– output ––– Copyright (c) 2023-2024, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp/ Available backups: 1 backup-%{NUMBER} (#!/(?:Jan|Feb|Mar|Apr|May|Jun|Jul|Aug|Sep|Oct|Nov|Dec)\s\d{1,2}\s\d{4}\s\d{2}:\d{2}:\d{2}/!#) ––– input ––– ls /tmp/ ––– output ––– backup-%{NUMBER} ––– input ––– export BACKUP_DATE=$(ls /tmp/) ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp/ --restore=$BACKUP_DATE ––– output ––– Copyright (c) 2023-2024, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp/ %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Starting to restore... Manticore config endpoint = http://%{IPADDR}:9312 Manticore config endpoint = http://%{IPADDR}:9312 %{DATETIME} [Info] Restoring config files... %{DATETIME} [Info] config files - OK %{DATETIME} [Info] Restoring state files... %{DATETIME} [Info] state files - OK %{DATETIME} [Info] Restoring data files... %{DATETIME} [Info] tables' files - OK %{DATETIME} [Info] The backup '/tmp/backup-%{NUMBER}' was successfully restored. %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s %{DATETIME} [Info] Done ––– input ––– ls /tmp/manticore.conf ––– output ––– /tmp/manticore.conf ––– input ––– ls /etc/manticoresearch/manticore.conf ––– output ––– /etc/manticoresearch/manticore.conf ```
tests/backup-single-table-ok.rec ```diff ––– input ––– cp ./tests/config/manticore.conf /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– searchd ––– output ––– - Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (secondary %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) (knn %{SEMVER} #!/[a-f0-9]{7}@[0-9]{6}/!#) + Manticore 6.2.13 27789eb1c@24052205 dev (columnar 2.2.5 b41a4fc@24051705) (secondary 2.2.5 b41a4fc@24051705) (knn 2.2.5 b41a4fc@24051705) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– +---------------------+-------------+ | Index | Type | +---------------------+-------------+ | distributed_index | distributed | | rt_with_columnar | rt | | rt_without_columnar | rt | | test | rt | +---------------------+-------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table distributed_index' ––– output ––– +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Table | Create Table | +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | distributed_index | CREATE TABLE distributed_index type='distributed' local='rt_with_columnar' local='rt_without_columnar' agent='127.0.0.1:9312:plain_with_columnar, plain_without_columnar' | +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table rt_with_columnar' ––– output ––– +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Table | Create Table | +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | rt_with_columnar | CREATE TABLE rt_with_columnar ( id bigint, title text, category_id integer, price float, description string attribute engine='columnar', tags multi, attributes json ) | +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table rt_without_columnar' ––– output ––– +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ | Table | Create Table | +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ | rt_without_columnar | CREATE TABLE rt_without_columnar ( id bigint, title text, category_id integer, price float, description string attribute, tags multi, attributes json ) | +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– ls -lt /tmp/backup-* ––– output ––– ls: cannot access '/tmp/backup-*': No such file or directory ––– input ––– manticore-backup --backup-dir=/tmp --tables=rt_without_columnar ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: rt_without_columnar Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... %{DATETIME} [Info] Backing up config files... %{DATETIME} [Info] config files - OK %{DATETIME} [Info] Backing up tables... %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] Running sync %{DATETIME} [Info] OK %{DATETIME} [Info] You can find backup here: /tmp/backup-#!/[0-9]{14}/!# %{DATETIME} [Info] Elapsed time: #!/[0-9]+\.[0-9]+|0/!#s %{DATETIME} [Info] Done %{DATETIME} [Info] Unfreezing all tables... %{DATETIME} [Info] distributed_index... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_with_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] test... %{DATETIME} [Info] OK ––– input ––– ls -lh /tmp/backup-* ––– output ––– total 16K %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# config %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# data %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# state %{FILEPERMS} %{NUMBER} root root %{NUMBER} #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# versions.json ––– input ––– ls -lh /tmp/backup-*/data/* ––– output ––– total 12K %{FILEPERMS} 1 root root %{NUMBER} #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# rt_without_columnar.meta %{FILEPERMS} 1 root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# rt_without_columnar.ram %{FILEPERMS} 1 root root %{NUMBER} #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# rt_without_columnar.settings ```