kaiko-ai / typedspark

Column-wise type annotations for pyspark DataFrames
Apache License 2.0
65 stars 4 forks source link

Change `structtype_column.dtype` from class to object, update dependency pyright to v1.1.348 #281

Closed renovate[bot] closed 9 months ago

renovate[bot] commented 9 months ago

Following this change to pyright, we had to change the type of SomeSchema.some_column.dtype from a Type[DataType] (i.e. a class) to DataType (i.e. an object). Otherwise, we could not support SomeSchema.some_structtype_column.dtype.schema anymore.

This change shouldn't affect end-users, unless they specifically use something like SomeSchema.some_column.dtype == LongType. That should be a very limited usecase. We'll release this as 1.3.0, as it does strictly change the interface.

In this PR, we're also muting some other new pyright errors. Since they're purely internal function calls, we can safely mute them.