search

Mquinn960 / streaming-data-pipeline

An end-to-end streaming data pipeline to parse CSV files at scale, demonstrated on Docker with docker-compose
GNU General Public License v3.0
1 stars 1 forks source link

Understanding the Code #3

Open MRaza98 opened 1 month ago

MRaza98 commented 1 month ago

Hi, thanks for posting your brilliant work!

I am trying to create a Kafka Stream from a csv file too and I am wondering if I can skip out on the Flask API part entirely? Is this the REST API that was the bonus task?

Appreciate your help!

Mquinn960 commented 1 month ago

Hey hey,

Yeah you could just skip the Flask step entirely here, this was a stipulation of the task I was given (use a REST endpoint) but you can ingest however you want of course