Separate repo for data ingestion pipelines to start aggregating (un)structured data from regulator websites.

WallStreetAnalytics / wallstreetanalytics

An endeavor to create an analytics tool to democratize the information hedge funds are creating teams to collect.

813 stars 30 forks source link

Separate repo for data ingestion pipelines to start aggregating (un)structured data from regulator websites. #14

Open athielen opened 3 years ago

athielen commented 3 years ago

Once a language for the team is voted on, it'd be nice to setup a separate repo for the data engineers and big data engineers to start pulling together existing and new solutions to ingest data from regulatory websites.

Start getting a solution setup for batch and real time processing.