kaizen-ai / kaizenflow

KaizenFlow is a framework for Bayesian reasoning and AI/ML stream computing
GNU General Public License v3.0
105 stars 74 forks source link

Spring2024_Windowed_Streaming_Analysis_With_Apache_Spark_Streaming #792

Open jacyu99 opened 2 months ago

jacyu99 commented 2 months ago

Description: Craft Python code within a notebook environment to orchestrate time-based aggregations, leveraging tumbling or sliding windows for granular insights into your streaming data. Refine your understanding by exploring additional functionalities like watermarking for event-time processing or incorporating external data sources for enriched analysis. Execute the Spark Streaming job seamlessly within your notebook to harness the power of distributed computing for real-time analytics. Dive deeper into Spark Streaming's capabilities, augmenting your skill set and empowering your data-driven decisions.

Link with Description: https://docs.google.com/document/d/1GEOmfpBUXiCua18wR1Hx1OMUVlku-1of/edit#heading=h.qizldccfcgdv

jacyu99 commented 2 months ago

I'm having the issue where the branch I created off of the cloned Sorrentum1 repository does not match up with the branch that was somehow automatically created for me in github online. Yesterday I created a branch called "SorrTask645_Windowed_Streaming_Analysis_With_Apache_Spark_Streaming" using my CLI on my laptop. However, the branch in the Kaisenflow repository online is called "792-spring2024_windowed_streaming_analysis_with_apache_spark_streaming" and says it was created 2 weeks ago. I never created this branch, but somehow it is showing up as created by my username.

The 2 branches are not the same, because when I made a commit to the branch I created (SorrTask645...) it did not update anything to the branch on the repo online.

Can you please help me troubleshoot this? I need to somehow sync the branches so that when I make updates, the changes are reflected online so you can see them. Below is a screenshot of my terminal showing I have a branch under the cloned Sorrentum1 repo. Screenshot 2024-04-25 at 1 28 16 PM