Closed pyjads closed 4 weeks ago
This isn't a bug. The error message prints a workaround. This query is not streaming.
@ritchie46 But the code works with version 0.20.3. Were there any changes to the streaming implementation?
To replace
and this was changed in 1.0
where we allowed to break. The new streaming engine will eventually be able to do this, but it will take a while. For now I'd recommend collect().write_parquet
.
Checks
Reproducible example
Log output
Issue description
The code above raises an InvalidOperationError, although the same operation works correctly in version 0.20.3.
Expected behavior
The sink operation should have written the LazyFrame to the Parquet file.
Installed versions