search

Tatoeba / tatoeba2

Tatoeba is a platform whose purpose is to create a collaborative and open dataset of sentences and their translations.
https://tatoeba.org
GNU Affero General Public License v3.0
704 stars 132 forks source link

Optimize filtering by native speakers #2203

Open jiru opened 4 years ago

jiru commented 4 years ago

Recently, in #2173, I fixed a bug in search filtering using a workaround. I now found a better solution that can scale better and eliminate the need of transmitting the whole list of native speakers for every query: server-side variables. According to this documentation, you can set the variable once, and then use it in a filter as a value for IN().

jiru commented 4 years ago

Another, simpler approach to work around the Manticore limitation is to set max-filter-values to a high enough value.