Continuous data pipeline to pre-process sources

NEUROFUSIONInc / fusion

Local-first behavior tracking and brain recording app. Discord: https://discord.gg/sqsuzXWE3K

https://usefusion.ai/research

Other

35 stars 8 forks source link

Continuous data pipeline to pre-process sources #7

Closed oreHGA closed 1 year ago

oreHGA commented 2 years ago

Continuous data pipeline to pre-process from github, spotify, web history from google chrome, twitter

oreHGA commented 1 year ago

Accepts:

[x] productivity data
[x] brain activity over time

oreHGA commented 1 year ago

The pending task here is to deploy the analytics script.

Tried to use azure functions earlier but the install step was failing on my mac .. will just deploy as another app service. (actually having this script run on an Azure ML schedule is probably what I want)

oreHGA commented 1 year ago

Closing this, pre-processing will happen per scenario. We're already storing in an okay enough format