okfn / measure

Measure is scripts and conventions to build KPI dashboards for projects.
MIT License
17 stars 5 forks source link

Twitter processor #19

Closed brew closed 7 years ago

brew commented 7 years ago

This pull request fixes #17 and is connected to #3.

Changes proposed in this pull request:

Processor retrieves two types of metrics, 'lifetime' metrics, such as followers, that are retrieved from the api, and used as-is without processing, and 'cumulative' metrics, such as mentions and interactions that are retrieved for a specific time-frame, then added to the latest stored result.

brew commented 7 years ago

@akariv I've refactored the twitter processor so it no longer aggregates locally.

I decided to keep the timestamp as it is, as it represents the datetime the data was collected, and I'd like to differentiate between the time collected (metadata) and the date for the data we're interested (which itself is data). So I've added a date column to represent the data date.