edit: I see this inherited from PyDantic, so probably root issue is there.
I have a df with the following field
class Table(pt.Model):
score: float | None = pt.Field(ge=0, le=1)
The score can be None, but if it's a float it should be between 0 and 1. However, patito is applying this validation checks on all rows, essentially completely ignoring the fact that I allow it too also be a None. Which results in this error:
ValidationError: 1 validation errors for Table
score
13183196 rows with out of bound values. (type=value_error.rowvalue)
edit: I see this inherited from PyDantic, so probably root issue is there.
I have a df with the following field
The score can be None, but if it's a float it should be between 0 and 1. However, patito is applying this validation checks on all rows, essentially completely ignoring the fact that I allow it too also be a None. Which results in this error: