NowanIlfideme / pydantic-cereal

Advanced serialization for Pydantic v2
MIT License
5 stars 0 forks source link

Lazy loading #47

Open NowanIlfideme opened 6 months ago

NowanIlfideme commented 6 months ago

Many useful cases we want to support would benefit greatly from lazy loading of objects from memory.

Currently, we don't support this. Likely blocker for PySpark (#35)? Also was an issue with reading Polars dataframes using scan_* functions.

Need to figure out how to support it via... lazy loading or something?