search

manticoresoftware / manticoresearch-backup

Repository for Manticore Search backup scripts
GNU General Public License v3.0
3 stars 1 forks source link

Fix lemmatizer files restore after wrong backup #118

Closed donhardman closed 2 months ago

github-actions[bot] commented 2 months ago

clt

👍 CLT tests in tests/ ✅ OK: 8 ❌ Failed: 0 ⏳ Duration: 23s 👉 Check Action Results for commit c116943

github-actions[bot] commented 2 months ago

clt

👎 CLT tests in tests/ ✅ OK: 7 ❌ Failed: 1 ⏳ Duration: 21s 👉 Check Action Results for commit 56ca35f Failed tests:

tests/backup-restore-ok.rec ```diff ––– input ––– cp ./tests/config/manticore.conf /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– searchd ––– output ––– Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE}) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– ––– input ––– touch /usr/share/manticore/{abc,zed}.pak ––– output ––– ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– +---------------------+-------------+ | Index | Type | +---------------------+-------------+ | distributed_index | distributed | | rt_with_columnar | rt | | rt_without_columnar | rt | | test | rt | +---------------------+-------------+ ––– input ––– manticore-backup --backup-dir=/tmp ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... %{DATETIME} [Info] Backing up config files... %{DATETIME} [Info] config files - OK %{DATETIME} [Info] Backing up global state files... %{DATETIME} [Info] global state files – OK %{DATETIME} [Info] Backing up tables... %{DATETIME} [Info] distributed_index (distributed)... %{DATETIME} [Info] SKIP %{DATETIME} [Info] rt_with_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] test (rt) [%{NUMBER}B]... %{DATETIME} [Info] OK %{DATETIME} [Info] Running sync %{DATETIME} [Info] OK %{DATETIME} [Info] You can find backup here: /tmp/backup-%{NUMBER} %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s %{DATETIME} [Info] Done %{DATETIME} [Info] Unfreezing all tables... %{DATETIME} [Info] distributed_index... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_with_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] test... %{DATETIME} [Info] OK ––– input ––– mv /tmp/backup-* /tmp/backup-111 ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp Available backups: 1 backup-111 (?) ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... %{DATETIME} [Error] Cannot initiate the restore process due to searchd daemon is running. ––– input ––– pgrep -f searchd | xargs kill -9 ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... Manticore config endpoint = http://%{IPADDR}:9312 %{DATETIME} [Error] Destination file already exists: /etc/manticoresearch/manticore.conf ––– input ––– rm /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... Manticore config endpoint = http://%{IPADDR}:9312 %{DATETIME} [Error] Destination file already exists: /var/lib/manticore/manticore.json ––– input ––– rm -fr /var/lib/manticore && mkdir -p /var/lib/manticore ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... Manticore config endpoint = http://%{IPADDR}:9312 %{DATETIME} [Info] Restoring config files... %{DATETIME} [Info] config files - OK %{DATETIME} [Info] Restoring state files... %{DATETIME} [Info] state files - OK %{DATETIME} [Info] Restoring data files... %{DATETIME} [Info] tables' files - OK %{DATETIME} [Info] The backup '/tmp/backup-111' was successfully restored. %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s %{DATETIME} [Info] Done ––– input ––– searchd ––– output ––– Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE}) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) precaching table 'rt_with_columnar' precaching table 'rt_without_columnar' precaching table 'test' WARNING: table 'distributed_index': ha_strategy defined, but no ha agents in the table precached 3 tables in #!/([0-9]+\.[0-9]+|0)/!# sec ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– +---------------------+-------------+ | Index | Type | +---------------------+-------------+ | distributed_index | distributed | | rt_with_columnar | rt | | rt_without_columnar | rt | | test | rt | +---------------------+-------------+ ––– input ––– ls /usr/share/manticore/{abc,zed}.pak ––– output ––– - /usr/share/manticore/abc.pak + /usr/share/manticore/abc.pak /usr/share/manticore/zed.pak - /usr/share/manticore/zed.pak + - ```
github-actions[bot] commented 2 months ago

clt

👎 CLT tests in tests/ ✅ OK: 7 ❌ Failed: 1 ⏳ Duration: 25s 👉 Check Action Results for commit 8669742 Failed tests:

tests/backup-restore-ok.rec ```diff ––– input ––– cp ./tests/config/manticore.conf /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– searchd ––– output ––– Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE}) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– ––– input ––– touch /usr/share/manticore/{abc,zed}.pak ––– output ––– ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– +---------------------+-------------+ | Index | Type | +---------------------+-------------+ | distributed_index | distributed | | rt_with_columnar | rt | | rt_without_columnar | rt | | test | rt | +---------------------+-------------+ ––– input ––– manticore-backup --backup-dir=/tmp ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... %{DATETIME} [Info] Backing up config files... %{DATETIME} [Info] config files - OK %{DATETIME} [Info] Backing up global state files... %{DATETIME} [Info] global state files – OK %{DATETIME} [Info] Backing up tables... %{DATETIME} [Info] distributed_index (distributed)... %{DATETIME} [Info] SKIP %{DATETIME} [Info] rt_with_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... %{DATETIME} [Info] OK %{DATETIME} [Info] test (rt) [%{NUMBER}B]... %{DATETIME} [Info] OK %{DATETIME} [Info] Running sync %{DATETIME} [Info] OK %{DATETIME} [Info] You can find backup here: /tmp/backup-%{NUMBER} %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s %{DATETIME} [Info] Done %{DATETIME} [Info] Unfreezing all tables... %{DATETIME} [Info] distributed_index... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_with_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] rt_without_columnar... %{DATETIME} [Info] OK %{DATETIME} [Info] test... %{DATETIME} [Info] OK ––– input ––– mv /tmp/backup-* /tmp/backup-111 ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp Available backups: 1 backup-111 (?) ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... %{DATETIME} [Error] Cannot initiate the restore process due to searchd daemon is running. ––– input ––– pgrep -f searchd | xargs kill -9 ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... Manticore config endpoint = http://%{IPADDR}:9312 %{DATETIME} [Error] Destination file already exists: /etc/manticoresearch/manticore.conf ––– input ––– rm /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... Manticore config endpoint = http://%{IPADDR}:9312 %{DATETIME} [Error] Destination file already exists: /var/lib/manticore/manticore.json ––– input ––– rm -fr /var/lib/manticore && mkdir -p /var/lib/manticore ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... Manticore config endpoint = http://%{IPADDR}:9312 %{DATETIME} [Info] Restoring config files... %{DATETIME} [Info] config files - OK %{DATETIME} [Info] Restoring state files... %{DATETIME} [Info] state files - OK %{DATETIME} [Info] Restoring data files... %{DATETIME} [Info] tables' files - OK %{DATETIME} [Info] The backup '/tmp/backup-111' was successfully restored. %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s %{DATETIME} [Info] Done ––– input ––– searchd ––– output ––– Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE}) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) precaching table 'rt_with_columnar' precaching table 'rt_without_columnar' precaching table 'test' WARNING: table 'distributed_index': ha_strategy defined, but no ha agents in the table precached 3 tables in #!/([0-9]+\.[0-9]+|0)/!# sec ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– +---------------------+-------------+ | Index | Type | +---------------------+-------------+ | distributed_index | distributed | | rt_with_columnar | rt | | rt_without_columnar | rt | | test | rt | +---------------------+-------------+ ––– input ––– ls /usr/share/manticore/{abc,zed}.pak ––– output ––– - /usr/share/manticore/abc.pak /usr/share/manticore/zed.pak + /usr/share/manticore/abc.pak /usr/share/manticore/zed.pak ```
github-actions[bot] commented 2 months ago

clt

👍 CLT tests in tests/ ✅ OK: 8 ❌ Failed: 0 ⏳ Duration: 23s 👉 Check Action Results for commit 13495b9

github-actions[bot] commented 2 months ago

clt

👎 CLT tests in test/clt-tests/ ✅ OK: 1 ❌ Failed: 7 ⏳ Duration: 19s 👉 Check Action Results for commit b843a32 Failed tests:

test/clt-tests/backup-all-ok.rec ```diff ––– input ––– cp ./tests/config/manticore.conf /etc/manticoresearch/manticore.conf ––– output ––– + cp: cannot stat './tests/config/manticore.conf': No such file or directory ––– input ––– searchd ––– output ––– Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE}) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– + bash: tests/dumps/tables.sql: No such file or directory ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– - +---------------------+-------------+ - | Index | Type | - +---------------------+-------------+ - | distributed_index | distributed | - | rt_with_columnar | rt | - | rt_without_columnar | rt | - | test | rt | - +---------------------+-------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table distributed_index' ––– output ––– - +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ + ERROR 1064 (42000) at line 1: You have an error in your query. Please, double-check it. - | Table | Create Table | - +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ - | distributed_index | CREATE TABLE distributed_index type='distributed' local='rt_with_columnar' local='rt_without_columnar' agent='127.0.0.1:9312:plain_with_columnar, plain_without_columnar' | - +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table rt_with_columnar' ––– output ––– - +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ + ERROR 1064 (42000) at line 1: You have an error in your query. Please, double-check it. - | Table | Create Table | - +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ - | rt_with_columnar | CREATE TABLE rt_with_columnar ( - id bigint, - title text, - category_id integer, - price float, - description string attribute engine='columnar', - tags multi, - attributes json - ) | - +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table rt_without_columnar' ––– output ––– - +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ + ERROR 1064 (42000) at line 1: You have an error in your query. Please, double-check it. - | Table | Create Table | - +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ - | rt_without_columnar | CREATE TABLE rt_without_columnar ( - id bigint, - title text, - category_id integer, - price float, - description string attribute, - tags multi, - attributes json - ) | - +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– ls -lt /tmp/backup-* ––– output ––– ls: cannot access '/tmp/backup-*': No such file or directory ––– input ––– mysql -h0 -P9306 -e "flush ramchunk test; select * from test.@files;" ––– output ––– - +------+---------------------------------------+---------------------------------------+--------+ + ERROR 1064 (42000) at line 1: FLUSH RAMCHUNK requires an existing RT table - | id | file | normalized | size | - +------+---------------------------------------+---------------------------------------+--------+ - | 2 | /var/lib/manticore/test/test.settings | /var/lib/manticore/test/test.settings | %{NUMBER} | - | 3 | /var/lib/manticore/test/test.0.sph | /var/lib/manticore/test/test.0.sph | %{NUMBER} | - | 4 | /var/lib/manticore/test/test.0.spd | /var/lib/manticore/test/test.0.spd | %{NUMBER} | - | 5 | /var/lib/manticore/test/test.0.spp | /var/lib/manticore/test/test.0.spp | %{NUMBER} | - | 6 | /var/lib/manticore/test/test.0.spe | /var/lib/manticore/test/test.0.spe | %{NUMBER} | - | 7 | /var/lib/manticore/test/test.0.spi | /var/lib/manticore/test/test.0.spi | %{NUMBER} | - | 8 | /var/lib/manticore/test/test.0.spm | /var/lib/manticore/test/test.0.spm | %{NUMBER} | - | 9 | /var/lib/manticore/test/test.0.sphi | /var/lib/manticore/test/test.0.sphi | %{NUMBER} | - | 10 | /var/lib/manticore/test/test.0.spds | /var/lib/manticore/test/test.0.spds | %{NUMBER} | - | 11 | /var/lib/manticore/test/test.0.spknn | /var/lib/manticore/test/test.0.spknn | %{NUMBER} | - | 12 | /var/lib/manticore/test/test.0.spt | /var/lib/manticore/test/test.0.spt | %{NUMBER} | - | 13 | /var/lib/manticore/test/test.0.spidx | /var/lib/manticore/test/test.0.spidx | %{NUMBER} | - | 14 | /var/lib/manticore/test/test.0.spa | /var/lib/manticore/test/test.0.spa | %{NUMBER} | - | 15 | /var/lib/manticore/test/test.0.spb | /var/lib/manticore/test/test.0.spb | %{NUMBER} | - | 1 | /var/lib/manticore/test/test.meta | /var/lib/manticore/test/test.meta | %{NUMBER} | - +------+---------------------------------------+---------------------------------------+--------+ ––– input ––– manticore-backup --backup-dir=/tmp ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... - %{DATETIME} [Info] Backing up config files... + 2024-07-09 08:18:38 [Error] You have no tables to backup. - %{DATETIME} [Info] config files - OK - %{DATETIME} [Info] Backing up global state files... - %{DATETIME} [Info] global state files – OK - %{DATETIME} [Info] Backing up tables... - %{DATETIME} [Info] distributed_index (distributed)... - %{DATETIME} [Info] SKIP - %{DATETIME} [Info] rt_with_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] test (rt) [#!/[0-9]{3}\.[0-9]{3}/!#K]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] Running sync - %{DATETIME} [Info] OK - %{DATETIME} [Info] You can find backup here: /tmp/backup-#!/[0-9]{14}/!# - %{DATETIME} [Info] Elapsed time: #!/[0-9]+/!#.#!/[0-9]+/!#s - %{DATETIME} [Info] Done - %{DATETIME} [Info] - Unfreezing all tables... - %{DATETIME} [Info] distributed_index... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_with_columnar... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_without_columnar... - %{DATETIME} [Info] OK - %{DATETIME} [Info] test... - %{DATETIME} [Info] OK ––– input ––– ls -lh /tmp/backup-* ––– output ––– total 16K %{FILEPERMS} %{NUMBER} root root 4.0K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# config %{FILEPERMS} %{NUMBER} root root 4.0K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# data %{FILEPERMS} %{NUMBER} root root 4.0K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# state %{FILEPERMS} %{NUMBER} root root %{NUMBER} #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# versions.json ––– input ––– ls -1v /tmp/backup-*/data/test/ ––– output ––– - test.meta + ls: cannot access '/tmp/backup-*/data/test/': No such file or directory - test.settings + - test.0.spa - test.0.spb - test.0.spd - test.0.spds - test.0.spe - test.0.sph - test.0.sphi - test.0.spi - test.0.spidx - test.0.spknn - test.0.spm - test.0.spp - test.0.spt - ```
test/clt-tests/backup-restore-ok.rec ```diff ––– input ––– cp ./tests/config/manticore.conf /etc/manticoresearch/manticore.conf ––– output ––– + cp: cannot stat './tests/config/manticore.conf': No such file or directory ––– input ––– searchd ––– output ––– Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE}) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– + bash: tests/dumps/tables.sql: No such file or directory ––– input ––– touch /usr/share/manticore/{abc,zed}.pak ––– output ––– ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– - +---------------------+-------------+ - | Index | Type | - +---------------------+-------------+ - | distributed_index | distributed | - | rt_with_columnar | rt | - | rt_without_columnar | rt | - | test | rt | - +---------------------+-------------+ ––– input ––– manticore-backup --backup-dir=/tmp ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... - %{DATETIME} [Info] Backing up config files... + 2024-07-09 08:18:42 [Error] You have no tables to backup. - %{DATETIME} [Info] config files - OK - %{DATETIME} [Info] Backing up global state files... - %{DATETIME} [Info] global state files – OK - %{DATETIME} [Info] Backing up tables... - %{DATETIME} [Info] distributed_index (distributed)... - %{DATETIME} [Info] SKIP - %{DATETIME} [Info] rt_with_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] test (rt) [%{NUMBER}B]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] Running sync - %{DATETIME} [Info] OK - %{DATETIME} [Info] You can find backup here: /tmp/backup-%{NUMBER} - %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s - %{DATETIME} [Info] Done - %{DATETIME} [Info] - Unfreezing all tables... - %{DATETIME} [Info] distributed_index... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_with_columnar... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_without_columnar... - %{DATETIME} [Info] OK - %{DATETIME} [Info] test... - %{DATETIME} [Info] OK ––– input ––– mv /tmp/backup-* /tmp/backup-111 ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp Available backups: 1 backup-111 (?) ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... %{DATETIME} [Error] Cannot initiate the restore process due to searchd daemon is running. ––– input ––– pgrep -f searchd | xargs kill -9 ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... - Manticore config + 2024-07-09 08:18:43 [Error] Failed to find config file in original backup - endpoint = http://%{IPADDR}:9312 - %{DATETIME} [Error] Destination file already exists: /etc/manticoresearch/manticore.conf ––– input ––– rm /etc/manticoresearch/manticore.conf ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... - Manticore config + 2024-07-09 08:18:43 [Error] Failed to find config file in original backup - endpoint = http://%{IPADDR}:9312 - %{DATETIME} [Error] Destination file already exists: /var/lib/manticore/manticore.json ––– input ––– rm -fr /var/lib/manticore && mkdir -p /var/lib/manticore ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp --restore=backup-111 ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"0.0.0"} %{DATETIME} [Info] Starting to restore... - Manticore config + 2024-07-09 08:18:43 [Error] Failed to find config file in original backup - endpoint = http://%{IPADDR}:9312 - %{DATETIME} [Info] Restoring config files... - %{DATETIME} [Info] config files - OK - %{DATETIME} [Info] Restoring state files... - %{DATETIME} [Info] state files - OK - %{DATETIME} [Info] Restoring data files... - %{DATETIME} [Info] tables' files - OK - %{DATETIME} [Info] The backup '/tmp/backup-111' was successfully restored. - %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s - %{DATETIME} [Info] Done ––– input ––– searchd ––– output ––– Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE}) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) - [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... + [18:43.135] [161] FATAL: no readable config file (looked in /etc/manticoresearch/manticore.conf, ./manticore.conf). - starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... - listening on %{IPADDR}:9312 for sphinx and http(s) - listening on %{IPADDR}:9306 for mysql - listening on %{IPADDR}:9308 for sphinx and http(s) - precaching table 'rt_with_columnar' - precaching table 'rt_without_columnar' - precaching table 'test' - WARNING: table 'distributed_index': ha_strategy defined, but no ha agents in the table - precached 3 tables in #!/([0-9]+\.[0-9]+|0)/!# sec ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– - +---------------------+-------------+ + ERROR 2003 (HY000): Can't connect to MySQL server on '0:9306' (111) - | Index | Type | - +---------------------+-------------+ - | distributed_index | distributed | - | rt_with_columnar | rt | - | rt_without_columnar | rt | - | test | rt | - +---------------------+-------------+ ––– input ––– ls /usr/share/manticore/{abc,zed}.pak ––– output ––– /usr/share/manticore/abc.pak /usr/share/manticore/zed.pak ```
test/clt-tests/backup-fails.rec ```diff ––– input ––– cp ./tests/config/manticore.conf /etc/manticoresearch/manticore.conf ––– output ––– + cp: cannot stat './tests/config/manticore.conf': No such file or directory ––– input ––– searchd ––– output ––– Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE}) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– + bash: tests/dumps/tables.sql: No such file or directory ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– - +---------------------+-------------+ - | Index | Type | - +---------------------+-------------+ - | distributed_index | distributed | - | rt_with_columnar | rt | - | rt_without_columnar | rt | - | test | rt | - +---------------------+-------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table distributed_index' ––– output ––– - +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ + ERROR 1064 (42000) at line 1: You have an error in your query. Please, double-check it. - | Table | Create Table | - +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ - | distributed_index | CREATE TABLE distributed_index type='distributed' local='rt_with_columnar' local='rt_without_columnar' agent='127.0.0.1:9312:plain_with_columnar, plain_without_columnar' | - +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table rt_with_columnar' ––– output ––– - +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ + ERROR 1064 (42000) at line 1: You have an error in your query. Please, double-check it. - | Table | Create Table | - +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ - | rt_with_columnar | CREATE TABLE rt_with_columnar ( - id bigint, - title text, - category_id integer, - price float, - description string attribute engine='columnar', - tags multi, - attributes json - ) | - +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table rt_without_columnar' ––– output ––– - +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ + ERROR 1064 (42000) at line 1: You have an error in your query. Please, double-check it. - | Table | Create Table | - +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ - | rt_without_columnar | CREATE TABLE rt_without_columnar ( - id bigint, - title text, - category_id integer, - price float, - description string attribute, - tags multi, - attributes json - ) | - +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– ls -lt /tmp/non-exist ––– output ––– ls: cannot access '/tmp/non-exist': No such file or directory ––– input ––– manticore-backup --backup-dir=/tmp/non-exist ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) %{DATETIME} [Error] Failed to find backup dir to store backup: /tmp/non-exist ––– input ––– manticore-backup --backup-dir=/tmp --tables=none ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: none Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... %{DATETIME} [Error] Can't find some of the tables: none ––– input ––– pgrep -f searchd | xargs kill ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 %{DATETIME} [Error] Failed to send query to the Manticore Search daemon. Ensure that it is set up to listen for HTTP or HTTPS connections and has the appropriate certificates in place. Additionally, check the 'max_connections' setting in the configuration file to ensure that it has not been exceeded. ```
test/clt-tests/backup-single-table-ok.rec ```diff ––– input ––– cp ./tests/config/manticore.conf /etc/manticoresearch/manticore.conf ––– output ––– + cp: cannot stat './tests/config/manticore.conf': No such file or directory ––– input ––– searchd ––– output ––– Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE}) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– + bash: tests/dumps/tables.sql: No such file or directory ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– - +---------------------+-------------+ - | Index | Type | - +---------------------+-------------+ - | distributed_index | distributed | - | rt_with_columnar | rt | - | rt_without_columnar | rt | - | test | rt | - +---------------------+-------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table distributed_index' ––– output ––– - +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ + ERROR 1064 (42000) at line 1: You have an error in your query. Please, double-check it. - | Table | Create Table | - +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ - | distributed_index | CREATE TABLE distributed_index type='distributed' local='rt_with_columnar' local='rt_without_columnar' agent='127.0.0.1:9312:plain_with_columnar, plain_without_columnar' | - +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table rt_with_columnar' ––– output ––– - +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ + ERROR 1064 (42000) at line 1: You have an error in your query. Please, double-check it. - | Table | Create Table | - +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ - | rt_with_columnar | CREATE TABLE rt_with_columnar ( - id bigint, - title text, - category_id integer, - price float, - description string attribute engine='columnar', - tags multi, - attributes json - ) | - +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9306 -e 'show create table rt_without_columnar' ––– output ––– - +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ + ERROR 1064 (42000) at line 1: You have an error in your query. Please, double-check it. - | Table | Create Table | - +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ - | rt_without_columnar | CREATE TABLE rt_without_columnar ( - id bigint, - title text, - category_id integer, - price float, - description string attribute, - tags multi, - attributes json - ) | - +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– ls -lt /tmp/backup-* ––– output ––– ls: cannot access '/tmp/backup-*': No such file or directory ––– input ––– manticore-backup --backup-dir=/tmp --tables=rt_without_columnar ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: rt_without_columnar Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... - %{DATETIME} [Info] Backing up config files... + 2024-07-09 08:18:45 [Error] Can't find some of the tables: rt_without_columnar - %{DATETIME} [Info] config files - OK - %{DATETIME} [Info] Backing up tables... - %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] Running sync - %{DATETIME} [Info] OK - %{DATETIME} [Info] You can find backup here: /tmp/backup-#!/[0-9]{14}/!# - %{DATETIME} [Info] Elapsed time: #!/[0-9]+\.[0-9]+|0/!#s - %{DATETIME} [Info] Done - %{DATETIME} [Info] - Unfreezing all tables... - %{DATETIME} [Info] distributed_index... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_with_columnar... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_without_columnar... - %{DATETIME} [Info] OK - %{DATETIME} [Info] test... - %{DATETIME} [Info] OK ––– input ––– ls -lh /tmp/backup-* ––– output ––– total 16K %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# config %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# data %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# state %{FILEPERMS} %{NUMBER} root root %{NUMBER} #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# versions.json ––– input ––– ls -lh /tmp/backup-*/data/* ––– output ––– - total 12K + ls: cannot access '/tmp/backup-*/data/*': No such file or directory - %{FILEPERMS} 1 root root %{NUMBER} #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# rt_without_columnar.meta + - %{FILEPERMS} 1 root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# rt_without_columnar.ram - %{FILEPERMS} 1 root root %{NUMBER} #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# rt_without_columnar.settings - ```
test/clt-tests/backup-shebang-config-ok.rec ```diff ––– input ––– cp tests/config/manticore.sh /etc/manticoresearch/manticore.conf ––– output ––– + cp: cannot stat 'tests/config/manticore.sh': No such file or directory ––– input ––– searchd ––– output ––– Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE}) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... - listening on all interfaces for mysql, port=9306 + listening on 127.0.0.1:9312 for sphinx and http(s) - listening on UNIX socket /var/run/mysqld/mysqld.sock + listening on 127.0.0.1:9306 for mysql - listening on %{IPADDR}:9312 for sphinx and http(s) + listening on 127.0.0.1:9308 for sphinx and http(s) - listening on all interfaces for sphinx and http(s), port=9308 ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– + bash: tests/dumps/tables.sql: No such file or directory ––– input ––– ls -lt /tmp/backup-* ––– output ––– ls: cannot access '/tmp/backup-*': No such file or directory ––– input ––– manticore-backup --backup-dir=/tmp ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... - %{DATETIME} [Info] Backing up config files... + 2024-07-09 08:18:44 [Error] You have no tables to backup. - %{DATETIME} [Info] config files - OK - %{DATETIME} [Info] Backing up global state files... - %{DATETIME} [Info] global state files – OK - %{DATETIME} [Info] Backing up tables... - %{DATETIME} [Info] distributed_index (distributed)... - %{DATETIME} [Info] SKIP - %{DATETIME} [Info] rt_with_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] test (rt) [%{NUMBER}B]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] Running sync - %{DATETIME} [Info] OK - %{DATETIME} [Info] You can find backup here: /tmp/backup-%{NUMBER} - %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s - %{DATETIME} [Info] Done - %{DATETIME} [Info] - Unfreezing all tables... - %{DATETIME} [Info] distributed_index... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_with_columnar... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_without_columnar... - %{DATETIME} [Info] OK - %{DATETIME} [Info] test... - %{DATETIME} [Info] OK ––– input ––– ls -lh /tmp/backup-* ––– output ––– total 16K %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# config %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# data %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# state %{FILEPERMS} %{NUMBER} root root %{NUMBER} #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# versions.json ```
test/clt-tests/backup-works-with-max-connections.rec ```diff ––– input ––– cp tests/config/manticore-vip.conf /etc/manticoresearch/manticore.conf ––– output ––– + cp: cannot stat 'tests/config/manticore-vip.conf': No such file or directory ––– input ––– searchd ––– output ––– Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE}) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql - listening on %{IPADDR}:9307 for VIP mysql + listening on 127.0.0.1:9308 for sphinx and http(s) - listening on %{IPADDR}:9308 for sphinx and http(s) - listening on %{IPADDR}:9313 for VIP sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– + bash: tests/dumps/tables.sql: No such file or directory ––– input ––– curl localhost:9312/sql?mode=raw -d 'query=debug sleep 10' & ––– output ––– [1] %{NUMBER} ––– input ––– mysql -h0 -P9307 -e 'show tables' ––– output ––– - +---------------------+-------------+ + ERROR 2003 (HY000): Can't connect to MySQL server on '0:9307' (111) - | Index | Type | - +---------------------+-------------+ - | distributed_index | distributed | - | rt_with_columnar | rt | - | rt_without_columnar | rt | - | test | rt | - +---------------------+-------------+ ––– input ––– mysql -h0 -P9307 -e 'show create table distributed_index' ––– output ––– - +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ + ERROR 2003 (HY000): Can't connect to MySQL server on '0:9307' (111) - | Table | Create Table | - +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ - | distributed_index | CREATE TABLE distributed_index type='distributed' local='rt_with_columnar' local='rt_without_columnar' agent='127.0.0.1:9312:plain_with_columnar, plain_without_columnar' | - +-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9307 -e 'show create table rt_with_columnar' ––– output ––– - +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ + ERROR 2003 (HY000): Can't connect to MySQL server on '0:9307' (111) - | Table | Create Table | - +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ - | rt_with_columnar | CREATE TABLE rt_with_columnar ( - id bigint, - title text, - category_id integer, - price float, - description string attribute engine='columnar', - tags multi, - attributes json - ) | - +------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– mysql -h0 -P9307 -e 'show create table rt_without_columnar' ––– output ––– - +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ + ERROR 2003 (HY000): Can't connect to MySQL server on '0:9307' (111) - | Table | Create Table | - +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ - | rt_without_columnar | CREATE TABLE rt_without_columnar ( - id bigint, - title text, - category_id integer, - price float, - description string attribute, - tags multi, - attributes json - ) | - +---------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ ––– input ––– ls -lt /tmp/backup-* ––– output ––– ls: cannot access '/tmp/backup-*': No such file or directory ––– input ––– manticore-backup --backup-dir=/tmp ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp Manticore config - endpoint = http://%{IPADDR}:9313 + endpoint = http://127.0.0.1:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... - %{DATETIME} [Info] Backing up config files... + 2024-07-09 08:18:46 [Error] You have no tables to backup. - %{DATETIME} [Info] config files - OK - %{DATETIME} [Info] Backing up global state files... - %{DATETIME} [Info] global state files – OK - %{DATETIME} [Info] Backing up tables... - %{DATETIME} [Info] distributed_index (distributed)... - %{DATETIME} [Info] SKIP - %{DATETIME} [Info] rt_with_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] test (rt) [%{NUMBER}B]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] Running sync - %{DATETIME} [Info] OK - %{DATETIME} [Info] You can find backup here: /tmp/backup-%{NUMBER} - %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s - %{DATETIME} [Info] Done ––– input ––– ls -lh /tmp/backup-* ––– output ––– total 16K %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# config %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# data %{FILEPERMS} %{NUMBER} root root #!/[0-9]{1}\.[0-9]{1}/!#K #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# state %{FILEPERMS} %{NUMBER} root root %{NUMBER} #!/[a-zA-Z]{3}/!# #!/[0-9]{1,2}/!# #!/[0-9]{2}:[0-9]{2}/!# versions.json ```
test/clt-tests/backup-conf.rec ```diff ––– input ––– cp /etc/manticoresearch/manticore.conf /tmp/ ––– output ––– ––– input ––– cp ./tests/config/manticore.conf /etc/manticoresearch/manticore.conf ––– output ––– + cp: cannot stat './tests/config/manticore.conf': No such file or directory ––– input ––– searchd ––– output ––– Manticore %{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE}) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) [#!/[0-9]{2}:[0-9]{2}\.[0-9]{3}/!#] [#!/[0-9]+/!#] using config file '/etc/manticoresearch/manticore.conf' (#!/[0-9]+/!# chars)... starting daemon version '%{SEMVER} %{COMMITDATE} dev (columnar %{SEMVER} %{COMMITDATE}) (secondary %{SEMVER} %{COMMITDATE}) (knn %{SEMVER} %{COMMITDATE})' ... listening on %{IPADDR}:9312 for sphinx and http(s) listening on %{IPADDR}:9306 for mysql listening on %{IPADDR}:9308 for sphinx and http(s) ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 < tests/dumps/tables.sql ––– output ––– + bash: tests/dumps/tables.sql: No such file or directory ––– input ––– manticore-backup --version ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore Backup version: %{SEMVER} ––– input ––– mysql -h0 -P9306 -e 'show tables' ––– output ––– - +---------------------+-------------+ - | Index | Type | - +---------------------+-------------+ - | distributed_index | distributed | - | rt_with_columnar | rt | - | rt_without_columnar | rt | - | test | rt | - +---------------------+-------------+ ––– input ––– manticore-backup --config=/etc/manticoresearch/manticore.conf --config=/tmp/manticore.conf --backup-dir=/tmp/ ––– output ––– Copyright (c) %{YEAR}-%{YEAR}, Manticore Software LTD (https://manticoresearch.com) Manticore config file: /etc/manticoresearch/manticore.conf Tables to backup: all tables Backup dir: /tmp/ Manticore config endpoint = http://%{IPADDR}:9312 Manticore config endpoint = http://%{IPADDR}:9312 Manticore versions: manticore: %{SEMVER} %{COMMITDATE} dev columnar: %{SEMVER} %{COMMITDATE} secondary: %{SEMVER} %{COMMITDATE} knn: %{SEMVER} %{COMMITDATE} buddy: %{SEMVER} %{DATETIME} [Info] Starting the backup... - %{DATETIME} [Info] Backing up config files... + 2024-07-09 08:18:39 [Error] You have no tables to backup. - %{DATETIME} [Info] config files - OK - %{DATETIME} [Info] Backing up global state files... - %{DATETIME} [Info] global state files – OK - %{DATETIME} [Info] Backing up tables... - %{DATETIME} [Info] distributed_index (distributed)... - %{DATETIME} [Info] SKIP - %{DATETIME} [Info] rt_with_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_without_columnar (rt) [#!/[0-9]{1}\.[0-9]{3}/!#K]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] test (rt) [%{NUMBER}B]... - %{DATETIME} [Info] OK - %{DATETIME} [Info] Running sync - %{DATETIME} [Info] OK - %{DATETIME} [Info] You can find backup here: /tmp/backup-%{NUMBER} - %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s - %{DATETIME} [Info] Done - %{DATETIME} [Info] - Unfreezing all tables... - %{DATETIME} [Info] distributed_index... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_with_columnar... - %{DATETIME} [Info] OK - %{DATETIME} [Info] rt_without_columnar... - %{DATETIME} [Info] OK - %{DATETIME} [Info] test... - %{DATETIME} [Info] OK ––– input ––– rm -rf /etc/manticoresearch/manticore.conf /tmp/manticore.conf /var/lib/manticore; mkdir /var/lib/manticore; ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp/ --restore ––– output ––– Copyright (c) 2023-2024, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp/ Available backups: 1 backup-%{NUMBER} (#!/(?:Jan|Feb|Mar|Apr|May|Jun|Jul|Aug|Sep|Oct|Nov|Dec)\s\d{1,2}\s\d{4}\s\d{2}:\d{2}:\d{2}/!#) ––– input ––– ls /tmp/ ––– output ––– backup-%{NUMBER} ––– input ––– export BACKUP_DATE=$(ls /tmp/) ––– output ––– ––– input ––– manticore-backup --backup-dir=/tmp/ --restore=$BACKUP_DATE ––– output ––– Copyright (c) 2023-2024, Manticore Software LTD (https://manticoresearch.com) Manticore config file: Backup dir: /tmp/ %{DATETIME} [Info] Stored versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Current versions: {"backup":"%{SEMVER}","manticore":"%{SEMVER} %{COMMITDATE} dev","columnar":"%{SEMVER} %{COMMITDATE}","secondary":"%{SEMVER} %{COMMITDATE}","knn":"%{SEMVER} %{COMMITDATE}","buddy":"%{SEMVER}"} %{DATETIME} [Info] Starting to restore... - Manticore config + 2024-07-09 08:18:40 [Error] Failed to find config file in original backup - endpoint = http://%{IPADDR}:9312 - Manticore config - endpoint = http://%{IPADDR}:9312 - %{DATETIME} [Info] Restoring config files... - %{DATETIME} [Info] config files - OK - %{DATETIME} [Info] Restoring state files... - %{DATETIME} [Info] state files - OK - %{DATETIME} [Info] Restoring data files... - %{DATETIME} [Info] tables' files - OK - %{DATETIME} [Info] The backup '/tmp/backup-%{NUMBER}' was successfully restored. - %{DATETIME} [Info] Elapsed time: #!/([0-9]+\.[0-9]+|0)/!#s - %{DATETIME} [Info] Done ––– input ––– ls /tmp/manticore.conf ––– output ––– - /tmp/manticore.conf + ls: cannot access '/tmp/manticore.conf': No such file or directory ––– input ––– ls /etc/manticoresearch/manticore.conf ––– output ––– - /etc/manticoresearch/manticore.conf + ls: cannot access '/etc/manticoresearch/manticore.conf': No such file or directory ```
github-actions[bot] commented 2 months ago

clt

👎 CLT tests in test/clt-test/clt-tests/ ✅ OK: 0 ❌ Failed: 1 ⏳ Duration: 10s 👉 Check Action Results for commit 632c988 Failed tests:

test/clt-test/clt-tests/*.rec ```diff ```