njfritter poc-data-pipelines issues

njfritter / poc-data-pipelines

Proof-of-Concept (POC) Data Pipelines for various use cases such as data streaming/ingestion, batch data processing, orchestration and storage. Includes technologies such as Apache Airflow, Apache Spark, Apache Kafka, AWS, Python and more

0 stars 0 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Update Batch + Speed Layers to Use Trade Timestamps and Not API Call Timestamps

#26 njfritter opened 6 months ago
0
Look into feasibility of implementing a REST API

#25 njfritter opened 7 months ago
0
Add Speed Layer of data pipeline

#24 njfritter closed 7 months ago
2
Hotfix for Python3.12 Python-Kafka Package Import

#23 njfritter closed 7 months ago
0
Create Cassandra Catalog for Speed Layer Table

#22 njfritter opened 7 months ago
0
Add Serving Layer of Kafka Spark Data Pipeline

#21 njfritter opened 7 months ago
0
Implement Multiple Data Model Methodologies

#20 njfritter opened 7 months ago
0
Post Project on LinkedIn

#19 njfritter opened 7 months ago
0
Combine all bash setup scripts into one script

#18 njfritter closed 7 months ago
1
Combine All Bash Setup Scripts into One Script

#17 njfritter closed 7 months ago
2
Update Pipeline to Query Coinbase API via Websockets

#16 njfritter opened 7 months ago
0
Choose Orchestration Engine + Add Batch ETL jobs via DBT

#15 njfritter opened 7 months ago
1
Update Pipeline to Have all Infrastructure in One Docker Container

#14 njfritter opened 7 months ago
0
Add Spark Streaming piece of Data Pipeline

#13 njfritter closed 7 months ago
1
Adding logging to Python scripts

#12 njfritter opened 7 months ago
0
Add Functionality to Coinbase Data Producer to Query Coinbase API "Products" Endpoint

#11 njfritter opened 7 months ago
0
Add Unit Testing for Kafka Piece of Data Pipeline

#10 njfritter opened 7 months ago
0
Add Architecture Diagram for Local Environment Setup

#9 njfritter opened 7 months ago
0
Replicate Full Local Data Pipeline in AWS

#8 njfritter opened 7 months ago
0
Add Unit + Integration Testing to Python Scripts

#7 njfritter opened 7 months ago
0
Add Speed Layer Piece of Data Pipeline

#6 njfritter closed 7 months ago
3
Build an Analytics UI showing Transformed Financial Data

#5 njfritter opened 7 months ago
0
Add Batch Layer Piece of Data Pipeline

#4 njfritter opened 7 months ago
2
Add Spark Streaming Piece of Data Pipeline

#3 njfritter closed 7 months ago
0
Add initial Kafka piece of Data Pipeline

#2 njfritter closed 7 months ago
1
Add initial piece of kafka spark pipeline

#1 njfritter closed 7 months ago
1