Training: Writing Python scripts in Snowflake directly for data analysis

[jkarpen]

This will be a training on doing data analysis within Snowflake using Python scripts, to avoid having to download the data and doing an analysis locally.

[jkarpen]

Notes from Mintu on the goals for what this session can look like:

Benefits:

• It will help to avoid downloading data from snowflake to conduct any analysis using pems data in local machine. This way we will not exhaust our local machine memory as well as avoid data movement from one platform to another
• It will provide the flexibility to choose any prefer time windows data based on interest and need
• It will help us to quick data pattern check by plotting the data using various python library such as matplotlib, seaborn, plotly etc. Although the sql worksheet provide some limited visualization option but Python will expand that visualization outside of current boundary.
• It will help us to deploy any complex machine learning model in snowflake environment that is not doable in sql

The training can be helpful if it includes following but not limited -

• How to import/update any python library in snowflake environment/worksheet?
• How to read data from snowflake warehouse?
• Example of some visualization using data from any schema
• Example of simple linear regression in Python
• Any other things that your team interested to share or may be useful for everyone.

[jkarpen]

Note from @ian-r-rose : this training should include discussion that even doing this analysis direct in Python, they will still want to put guardrails around the size of the data being analyzed to avoid incurring high costs since their data is so large. We should include guidance on when it makes sense to do this type of analysis in Snowflake directly vs. another option.