dask / dask-expr

BSD 3-Clause "New" or "Revised" License
83 stars 22 forks source link

Fix backend dispatching for `read_csv` #1028

Closed rjzamora closed 5 months ago

rjzamora commented 5 months ago

Backend dispatching doesn't currently work in all cases for read_cudf, because the operation property may be accessed outside a config context block. This PR resolves the issue by adding a "dataframe_backend" parameter.

rjzamora commented 5 months ago

Any objection here @phofl ?

Note that it's a bit simpler for rapids than marking the entire top-level read_csv function as "dispatchable" for now. However, that is exactly what we will need to do when the internal legacy-API fallback is removed.

phofl commented 5 months ago

thx