Support Sonic integration in addition to Elastic

[XVilka]

Sonic is a fast, lightweight and schema-less search backend. It ingests search texts and identifier tuples that can then be queried against in a microsecond's time. It implemented in Rust too, which makes it a perfect complement to Vector.

Sonic can be used as a simple alternative to super-heavy and full-featured search backends such as Elasticsearch in some use-cases. It is capable of normalizing natural language search queries, auto-completing a search query and providing the most relevant results for a query. Sonic is an identifier index, rather than a document index; when queried, it returns IDs that can then be used to refer to the matched documents in an external database.

A strong attention to performance and code cleanliness has been given when designing Sonic. It aims at being crash-free, super-fast and puts minimum strain on server resources (our measurements have shown that Sonic - when under load - responds to search queries in the μs range, eats ~30MB RAM and has a low CPU footprint; see our benchmarks).

[XVilka]

Apart from Sonic it makes sense also to support Toshi: https://github.com/toshi-search/Toshi

[binarylogic]

Thanks @XVilka, Sonic looks cool! We'll take a look and try to spec out what the integration would look like.

[deknos]

With the advent of Elasticsearch being SSPL, people are looking for elasticsearch alternatives for sinks, there are to my knowledge:

• sonic
• toshi
• Apache Solr
• bayard
• meilisearch
• tantivy

i am currently also evaluating which alternatives are interesting, but it would be really good if vector could support a few more opensource-product-sinks, though this is surely much work.

[deknos]

another sink would be arangodb as logging-storage-and-query-service

[yourchanges]

https://github.com/prabhatsharma/zinc and https://github.com/meilisearch/MeiliSearch