test queries that relies on the `url_search_string` field

mediacloud / news-search-api

Internal API server that offers search access to the Media Cloud Online News Archive (in Elasticsearch).

https://mediacloud.org

GNU Affero General Public License v3.0

1 stars 3 forks source link

test queries that relies on the `url_search_string` field #8

Closed rahulbot closed 9 months ago

rahulbot commented 11 months ago

We want to know whether our index failed on queries that utilize the url_search_string field. Some example query strings that can be used to test include:

"url:*dailyvoice.com*"
domain:dailyvoice.com AND url:*mountpleasant*
url:*dailyvoice.com/new-york/mountpleasant*

These should not throw any errors if working properly.

rahulbot commented 9 months ago

I was able to verify in news-search-query tool that these three work:

url:*dailyvoice.com*
canonical_domain:dailyvoice.com AND url:*mountpleasant*
url:*dailyvoice.com\/new-york\/mountpleasant* I think this means we do not have the same bug as is slowing integration with the Wayback Machine index. However it implies slashes in url string searches might need to be escaped (prefixed by \)