search

STFCcommunity / data

Food for bots, wikis, yournameits
Other
12 stars 13 forks source link

Push data to elasticsearch #5

Closed davejames closed 2 years ago

davejames commented 3 years ago

This is a proof of concept.

The github action works by running a python script which loops through the JSON files and pushes them up to an elasticsearch server whose details are stored as secrets in the GitHub repo. The ID of the record is taken from the filename, every time a push occurs it overwrites the values that were there previously.

WebSpider commented 3 years ago

This PR contains much more than just elasticsearch CI, with 60 files touched. Please make the PR for a single purpose

davejames commented 3 years ago

@WebSpider I have stripped the data out of the PR, it was included so that there was something to push to the server, but we can rebase once the data gets merged into the main branch

WebSpider commented 3 years ago

Thinking of this a bit further, @davejames, could you work out the PoC on a fork? That way we can just push a working setup for this to this repo, keep it clean.

Will keep this PR open for the final setup