Closed daikoz closed 1 year ago
sanikolaev
commented
3 years ago What are the versions of the instances running on SERVER1:9312, SERVER2:9312, SERVER3:9312, SERVER4:9312 ? Can you make sure there's no old 32-bit version of searchd?
daikoz
commented
3 years ago I check all servers (searchd -v). All versions of search are same on all servers.
The issue is randomly. one SERVER is localhost (127.0.0.1) and I have something the same error (in this case searchd it is sure searchd is same version).
We have the same configuration on prod with sphinx search 2.2.11-2+b1, no issue.
First post updated:
Operating system & version
All servers are the same configuration:
Debian GNU/Linux 10 (buster)
searchd -v
Manticore 3.6.0 96d61d8bf@210504 release
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2021, Manticore Software LTD (https://manticoresearch.com)Installation done by package manager like:
https://manticoresearch.com/downloads/
apt-key adv --fetch-keys 'http://repo.manticoresearch.com/GPG-KEY-manticore'
wget https://repo.manticoresearch.com/manticore-repo.noarch.deb
dpkg -i manticore-repo.noarch.deb
apt update
apt install manticore 
tomatolog
commented
3 years ago could you provide your config related to index from agent with index schema and one document for that index?
It could be master - agent issue related to index schema. Could you dump-header of the index from the agent - just to make sure what index version at agent.
daikoz
commented
3 years ago dump-header of the index from the agent
is it this that you want ?
mysql -h0 -P9306
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MySQL connection id is 682
Server version: 3.6.0 96d61d8bf@210504 release git branch HEAD (no branch)
same version on all servers
Database:
CREATE TABLE `SearchKeywords` (
`InsertedDate` timestamp NOT NULL DEFAULT current_timestamp(),
`Country` smallint(5) unsigned NOT NULL,
`Keywords` varchar(200) NOT NULL,
`Category` int(10) unsigned NOT NULL DEFAULT 0,
`Sort` tinyint(3) unsigned NOT NULL DEFAULT 0,
PRIMARY KEY (`Country`,`Keywords`,`Category`,`Sort`),
KEY `IDX_SearchKeywords` (`Country`,`InsertedDate`),
KEY `FK_SearchKeywords_Category_idx` (`Category`),
KEY `SearchKeywords_InsertedDate_IDX` (`InsertedDate`) USING BTREE,
CONSTRAINT `FK_SearchKeywords_Country` FOREIGN KEY (`Country`) REFERENCES `GeocalisationCountry` (`Id`) ON DELETE CASCADE ON UPDATE CASCADE
) ENGINE=InnoDB DEFAULT CHARSET=utf8;INSERT INTO SearchKeywords (InsertedDate, Country, Keywords, Category, Sort) VALUES(current_timestamp(), 826, 'caravane c', 4, 0); INSERT INTO SearchKeywords (InsertedDate, Country, Keywords, Category, Sort) VALUES(current_timestamp(), 826, 'caravane d', 4, 0); INSERT INTO SearchKeywords (InsertedDate, Country, Keywords, Category, Sort) VALUES(current_timestamp(), 826, 'caravane e', 4, 0); INSERT INTO SearchKeywords (InsertedDate, Country, Keywords, Category, Sort) VALUES(current_timestamp(), 826, 'caravane f', 4, 0);
Follow the manticore.conf.
searchd
{
listen = 9312
listen = 9306:mysql
pid_file = /var/run/manticore/searchd.pid
binlog_path = # disable logging
persistent_connections_limit = 30
#mysql_version_string = 5.0.37
log = /var/log/manticore/searchd.log
#query_log = /var/log/manticore/query.log
#query_log_format = sphinxql
}
indexer
{
mem_limit = 2047M
}
source default
{
type = mysql
sql_query_pre = SET SESSION TRANSACTION ISOLATION LEVEL READ UNCOMMITTED
sql_query_pre = SET SESSION query_cache_type=OFF
sql_query_pre = SET CHARACTER_SET_RESULTS=utf8
sql_query_pre = SET NAMES utf8
}
source dtv : default
{
sql_host = SQLHOST
sql_port = 3306
sql_user = USERNAME
sql_pass = PWD
sql_db = DBNAME
}
source SearchKeywords : dtv
{
sql_query = SELECT ROW_NUMBER() OVER(ORDER BY InsertedDate), UNIX_TIMESTAMP(InsertedDate) AS InsertedDateTS, Keywords, Country, Category \
FROM SearchKeywords \
WHERE InsertedDate > DATE_SUB(CURRENT_TIMESTAMP, INTERVAL 6 MONTH) AND Sort = 0
sql_attr_timestamp = InsertedDateTS
sql_field_string = Keywords
sql_attr_uint = Country
sql_attr_uint = Category
}
index default
{
charset_table = non_cjk
morphology = libstemmer_fr
stopwords = /usr/share/manticore/stopwords/fr
}
index SearchKeywords : default
{
source = SearchKeywords
path = /var/lib/manticore/data/SearchKeywords
}
#####################
# Load Balancing
#####################
index SearchKeywordsLB
{
type = distributed
agent_persistent = SERVER1:9312|SERVER2:9312|SERVER3:9312|SERVER4:9312:SearchKeywords
ha_strategy = nodeads
}
DESC TABLES
same on all servers
MySQL [(none)]> DESC SearchKeywords;
+----------------+-----------+------------+
| Field | Type | Properties |
+----------------+-----------+------------+
| id | bigint | |
| keywords | text | indexed |
| inserteddatets | timestamp | |
| keywords | string | |
| country | uint | |
| category | uint | |
+----------------+-----------+------------+
6 rows in set (0.000 sec)
If I comment the line in my manticore.conf:
persistent_connections_limit = 30
persistant connection is disable:
WARNING: index 'XXX': agent_persistent used, but no persistent_connections_limit defined. Fall back to non-persistent agent
and now, I cannot reproduce this issue.
I also try to increase persistent_connections_limit to 600: no change, issue is reproduced.
Thus, the issue is on the activation of persistent_connections_limit/agent_persistent.
Moreover, if i modify /etc/hosts to assign SERVER1, SERVER2, SERVER3 and SERVER4 to 127.0.0.1, i have the issue with persistent_connections_limit = 30
tomatolog
commented
3 years ago will try to reproduce issue with persist connection option
sanikolaev
commented
3 years ago reproduced
githubmanticore
commented
1 year ago ➤ Sergey Nikolaev commented:
We can't reproduce it in the latest dev version. I'm closing this issue. Feel free to reopen in case you can reproduce it again.
Hi,
I have randomly this error:
index MYINDEX: agent SERVERX:9312: agent has 32-bit docids; no longer supportedMy configuration index:
How to debug to provide more information about this randomly error ?
I try:
searchd --console --logdebugvFollow the debug log when I have this error "agent has 32-bit docids; no longer supported":
Operating system & version
All servers are the same configuration:
Debian GNU/Linux 10 (buster)Installation done by package manager like:
https://manticoresearch.com/downloads/