[x] I've added tests to cover the proposed changes
This PR adds a forum-categories pipeline and add_discourse_categories_resource processor. Closely related to the forums pipeline and add_discourse_resource processor.
The processor will collect daily data for each specified category in the config:
new_topics
new_posts
The processor config can accept a children flag that determines how to treat the subcategories of a given category:
none (default): only collect data for the specified category, ignoring subcategories
aggregate: add subcategory data values to the parent category rows
expand: add subcategory values as separate rows in the resource
This pull request closes #33.
This PR adds a
forum-categoriespipeline andadd_discourse_categories_resourceprocessor. Closely related to theforumspipeline andadd_discourse_resourceprocessor.The processor will collect daily data for each specified category in the config:
new_topicsnew_postsThe processor config can accept a
childrenflag that determines how to treat the subcategories of a given category:none(default): only collect data for the specified category, ignoring subcategoriesaggregate: add subcategory data values to the parent category rowsexpand: add subcategory values as separate rows in the resource