rapidsai / cudf

cuDF - GPU DataFrame Library
https://docs.rapids.ai/api/cudf/stable/
Apache License 2.0
8.37k stars 894 forks source link

[FEA] Report all unsupported operations for a query in cudf-polars #16690

Open wence- opened 1 month ago

wence- commented 1 month ago

Is your feature request related to a problem? Please describe.

Users of cudf-polars can run in to the situation where their (potentially complicated) query doesn't (yet) run on the GPU because we have not implemented support for all of the polars features they are using.

Right now, our fallback mechanism is to fail fast on the first unsupported feature. This works from a correctness point of view, but has some drawbacks:

Describe the solution you'd like

Instead, we should implement a mechanism whereby we traverse the entire query, collecting all the pieces that are not supported, and then raise an error for fallback, reporting all the (unique) unsupported pieces.

This would allow reports for unsupported queries to indicate all the missing pieces, and help us to prioritise things.

brandon-b-miller commented 3 weeks ago

Hey @Matt711 , I did a little preliminary investigating of how to do this, let me know if you want to connect and I can share my notes.