mediacloud / wayback-news-client

A client library to access the Wayback Machine news archive search.
Apache License 2.0
4 stars 2 forks source link

Add new integration tests against MC news-search-api and test ES data #17

Closed rahulbot closed 12 months ago

rahulbot commented 12 months ago

This set of wacky CI configurations adds a new test. It checkouts out news-search-api@main, uses that to insert test data into an ES instance via Docker, and then runs a smaller set of unit tests to verify results of using this API client work. Why? To help us make sure that this api-client can talk to the api-server as we expect it to in a controlled environment (ie. test ES data). This helps build confidence that we don't muck up a low-level integration, at the expense of adding more tests to maintain... kind of a classic tradeoff. See https://github.com/mediacloud/news-search-api/issues/27#issuecomment-1846462814 for more thoughts that led me here.

Maybe this won't be useful over time, but it seems useful right now as we are still working to establish production-level build and deployment processes across all these repos. I am going to merge so that I can continue the integration work up the call chain.

rahulbot commented 12 months ago

Merging because the WM integration tests that are failing are ones we aren't surprised by: