manticoresoftware / manticoresearch

Easy to use open source fast database for search | Good alternative to Elasticsearch now | Drop-in replacement for E in the ELK soon
https://manticoresearch.com
GNU General Public License v3.0
9.04k stars 507 forks source link

Manticore 2.8 is slow #182

Closed abhijo89-uc closed 5 years ago

abhijo89-uc commented 5 years ago

I forked benchmarks to https://github.com/abhijo89-uc/benchmarks/ and updated from plain index to rt index. then perform the same test . Its really slow !! Any comments ? Google sheet is : https://docs.google.com/spreadsheets/d/12Qea12nJC29u6UvansEAbnyBHNGQjgrxQSqsUIdZ-xg/edit#gid=1979954305

manticoresearch commented 5 years ago

Hi

As we discussed via email the problem is that in your case you get more than a hundred disk chunks which is an edge case. Yes, Sphinx 3 is faster in this case since it works with kill-lists differently. As we discussed you can do OPTIMIZE. We will also release Manticore v3 soon which also works fasts with so many disk chunks. I've sent you an archive containing that.

We'll keep it open until v3 is not released.

abhijo89-uc commented 5 years ago

:+1:

abhijo89-uc commented 5 years ago

Past few days i was in e-mail loop with @manticoresearch team Mr @adriannuta and Sergey Nikolaev. I got a change to do the same benchmark test for Upcoming Manitcore Release V3. Its mind blowing performance. I tested (We do regression test for our application, it include stop word, snippet, morphology rt bulk insert , sentence/paragraph etc.. ) the build with alpine 3.9.3 and Ubuntu 18.04 . All this test give really good performance improvement. Thanks for @manticoresearch Team . So this ticket is any more valid.

abhijo89-uc commented 5 years ago

I will be uploading google sheet Sphinx3 vs Manticore v3 Performance review after manticore release it version 3.

dzcpy commented 3 years ago

@abhijo89-uc May I know in your test, which system (alpine, ubuntu) performs better?