search

mediacloud / news-search-api

Internal API server that offers search access to the Media Cloud Online News Archive (in Elasticsearch).
https://mediacloud.org
GNU Affero General Public License v3.0
1 stars 3 forks source link

Top words for early 2022 are all Vietnamese? #78

Open pgulley opened 1 month ago

pgulley commented 1 month ago

image

@philbudne Noted, in investigating the status of re-indexing data from 2022, that the top-terms for a query from 2022-01-01 to 2022-12-31 seems to be entirely populated with Vietnamese words- despite vietnamese not being in the top 10 languages represented!

pgulley commented 1 month ago

No Vietnamese stopwords might be part of the issue, but probably doesn't cover this