blaylockbk / SynopticPy

Python wrapper for Synoptic Data API. Retrieve data from thousands of mesonet stations and networks. Returns JSON from Synoptic as Pandas DataFrame: https://developers.synopticdata.com
https://synopticpy.readthedocs.io/
MIT License
48 stars 6 forks source link

Rewrite using Polars #56

Open blaylockbk opened 4 months ago

blaylockbk commented 4 months ago

I'm inclined to re-write this using Polars. I love Polars!

blaylockbk commented 1 month ago

Note to self:

Saving a JSON copy of the returned data that for 18 stations, all variables for 1 month is ~25 MB on disk. Organizing the data into a Polars DataFrame and saved to Parquet is 131KB.

blaylockbk commented 3 weeks ago

I'm making great progress on this. Need a todo list

Code

Docs

GitHub