JSON serialize and deserialize polars datatypes - Githubissues

JakobGM / patito

A data modelling layer built on top of polars and pydantic

MIT License

252 stars 23 forks source link

JSON serialize and deserialize polars datatypes #35

Closed thomasaarholt closed 8 months ago

thomasaarholt commented 8 months ago

Downgrade Sphinx to compatible version
very rough draft for pydantic v2
fix: DataFrameValidationError mirrors pydantic v1 ValidationError
wip: subclass FieldInfo, extend with patito field attributes
fix: update LDF.collect() for polars==0.19.8
wip: restructure model reconstitution routines, all tests passing
chore: lockfile and formatting
fix: handle multiple annotations when dtype is present in Field
check: annotated dtypes match those specified in Field.dtype
chore: misc typing improvements
fix: search for nested field constraints on validation, ignore nulls
fix: better inference for column nullability
wip: better type mismatch messaging, move Representation to internal
wip: onto classproperty formulation in lieu of metaclass
wip: custom classproperty (from polars)
wip: robustify array dtype inference, add pt custom fields to Field()
feature: custom Field/FieldInfo constructors for better extensibility
fix: make _PatitoFieldInfo private, ensure ext fields -> _schema_props
wip: serialization
wip: modularize annotation -> dtype and dtype validation
Example serializing and deserializing polars datatypes