feat: add meta data to pipeline.

Leibniz-HBI / dabapush

Data Base pusher for social media data (Twitter for the beginning) – pre-alpha version

https://pypi.org/project/dabapush/

MIT License

0 stars 0 forks source link

feat: add meta data to pipeline. #42

Open pekasen opened 6 months ago

pekasen commented 6 months ago

Adds a Record-class with which data is wrapped and meta data are gathered through the pipeline. Adds additional tests for Record.py, NDJSONReader.py and TwacapicReader.py.

Coverage is now 60%

pekasen commented 4 months ago

looks alright, but untested by me. Would be good to find a way to get the CI checks running on GH

Yep, CI testing hangs itself on the dependency to smo-database, which is a private git-submodule as of yet. https://github.com/Leibniz-HBI/dabapush/pull/45 removes this and testing is then available in CI.