energy-modelling-ireland / ibsg

Generate a clean Irish building stock using this Python-based streamlit web application
https://share.streamlit.io/energy-modelling-ireland/ibsg/main/app.py
MIT License
1 stars 2 forks source link

Filter all BERs in 1GB of RAM #24

Open rdmolony opened 2 years ago

rdmolony commented 2 years ago

We need to find the right tool for the job. The BERs are >1GB uncompressed. pandas reads data into memory & so will crash in 1GB of RAM.

Options

rdmolony commented 2 years ago

See filter-via-* branches at https://github.com/rdmolony/ibsg for workings on: